Resources for Natural Language Processing †

• Organization@GitHub
• Team@Hugging Face Hub

Tools †

• KWJA

• JUMAN

• JUMAN++

• KNP
  • PyKNP : Python Bindings of JUMAN and KNP. (Japanese page)

• TableDisplay: For displaying parsing results. (Japanese page)

• KyotoEBMT

Data & Corpus †

• Kyoto University Text Corpus

• Kyoto University Web Document Leads Corpus

• Kyoto University Case Frame (Japanese page)

• Kyoto University Noun Case Frame (Japanese page)

• Food Knowledge Base (Japanese page)

• Recognizing Textual Entailment Evaluation Data (Japanese page)

• JEC Basic Sentence Data

• Predicate Evaluation Set

• Asian Scientific Paper Excerpt Corpus (ASPEC)
  • Workshop on Asian Translation (WAT)

• Chinese Penn Treebank 5.0 Reannotation

• Chinese Character-level POS Annotation

• A Chinese Treebank in Scientific Domain (SCTB)

• Kyoto University & JST Trilingual Technical Term Dictionary (TriTechDict)

• Wikipedia Chinese-Japanese Parallel Corpus

• FAQ Retrieval model

• Driving Domain QA Datasets

• Japanese Wikipedia Typo Dataset

• Japanese SNLI (JSNLI) Dataset (Japanese page)

• Kyoto University Commonsense Inference dataset

• Annotated FKC Corpus

• Coursera Parallel Corpus

• Japanese Movie Recommendation Dialogue

• Culinary Interview Dialog Corpus (CIDC)