Research Note

Research Note

doc2dial (query, 10 random candidates, document)

doc2dial_dataset_train.csv

doc2dial_dataset_valid.csv

doc2dial_dataset_test.csv

• doc2dial (query, document) and (document, ) (deprecated)

doc2dial (query, answer, document) and (document, )

doc2dial query-answer-document 데이터

• query: dialogue 첫번째 턴 (유저 질문)
• answer: dialogue 두번째 턴 (AI 답변)
• document: dialogue의 document (관련 문서)

doc2dial_query_answer_document_train.parquet

doc2dial_query_answer_document_validation.parquet

doc2dial_query_answer_document_test.parquet

doc2dial document 데이터

• document: split의 모든 document

doc2dial_documents_train.parquet

doc2dial_documents_validation.parquet

doc2dial_documents_test.parquet