Research Note
Research Note
doc2dial (query, 10 random candidates, document)
doc2dial_dataset_train.csv
doc2dial_dataset_valid.csv
doc2dial_dataset_test.csv
- doc2dial (query, document) and (document, ) (deprecated)
doc2dial (query, answer, document) and (document, )
doc2dial query-answer-document 데이터
- query: dialogue 첫번째 턴 (유저 질문)
- answer: dialogue 두번째 턴 (AI 답변)
- document: dialogue의 document (관련 문서)
doc2dial_query_answer_document_train.parquet
doc2dial_query_answer_document_validation.parquet
doc2dial_query_answer_document_test.parquet
doc2dial document 데이터
- document: split의 모든 document
doc2dial_documents_train.parquet
doc2dial_documents_validation.parquet
doc2dial_documents_test.parquet