awesome-japanese-nlp-resources

awesome-japanese-nlp-resources

A curated list of resources dedicated to Python libraries, llms, dictionaries, and corpora of NLP for Japanese

• Listed information on 895 GitHub repositories
• Listed information on 450 Hugging Face repositories (models and datasets)
• Listed information on 156 multilingual libraries, models, and datasets that also support Japanese

English | 日本語 (Japanese) | 繁體中文 (Chinese) | 简体中文 (Chinese)

🎉 The latest additions

Corpus

• jmeeteval - J-MeetEval: 日本語会議タスクにおける指示追従性評価ベンチマーク

Updated on Oct 13, 2026

Claude Code & Codex Plugin

Search, discover, and track Japanese NLP resources directly from Claude Code or Codex using the awesome-japanese-nlp-resources plugin. Both tools use the same skills and the same bundled data.

Claude Code:

# Add the marketplace and install
/plugin marketplace add taishi-i/awesome-japanese-nlp-resources
/plugin install awesome-japanese-nlp-resources@awesome-japanese-nlp-resources
/reload-plugins

Codex (run in your terminal, then start a new Codex session):

codex plugin marketplace add taishi-i/awesome-japanese-nlp-resources
codex plugin add awesome-japanese-nlp-resources@awesome-japanese-nlp-resources

The plugin ships four skills:

Skill	Purpose
/awesome-japanese-nlp-resources:search <query>	Search the bundled 1,200+ resource dataset
/awesome-japanese-nlp-resources:discover <tool-or-topic>	Given a tool, find alternatives (listed and unlisted); given a topic, find contribution candidates not yet in the list
/awesome-japanese-nlp-resources:compare <tool-or-topic>	Compare several libraries/models/datasets across a few criteria as a ○/△/✕ table
/awesome-japanese-nlp-resources:research <topic>	Survey the dataset + latest web research for a combined trend + challenges report

In Codex, call the same skills with $ instead of / (e.g. $awesome-japanese-nlp-resources:search <query>).

All skills detect the query language and respond in kind — English by default, Japanese when the query contains Japanese characters.

search example:

/awesome-japanese-nlp-resources:search What tutorials are recommended for beginners learning Japanese NLP?

Output includes a Use-case Selection Guide table:

Use case	Recommended	Popularity	Why
Learn modern NLP/LLM concepts from scratch	llm-book	⭐387	Most popular intro; covers LLMs end-to-end with practical Japanese code examples
Build practical skills through exercises	nlp100v2025	⭐82	Classic "100 Knock" challenge series; best way to learn by doing
Learn BERT and transformer-based NLP	bert-book	⭐262	Hands-on BERT programming with clear explanations for Japanese NLP beginners

For full documentation, see the plugin README.

Contents

• Hugging Face
  • Models
  • Datasets
• Python library
  • Morphology analysis
  • Parsing
  • Converter
  • Preprocessor
  • Sentence splitter
  • Sentiment analysis
  • Machine translation
  • Named entity recognition
  • OCR
  • Tool for pretrained models
  • Others
• C++
  • Morphology analysis
  • Parsing
  • Others
• Rust crate
  • Morphology analysis
  • Converter
  • Search engine library
  • Others
• JavaScript
  • Morphology analysis
  • Converter
  • Others
• Go
  • Morphology analysis
  • Others
• Java
  • Morphology analysis
  • Others
• Pretrained model
  • Word2Vec
  • Transformer based models
• ChatGPT
• Dictionary and IME
• Corpus
  • Part-of-speech tagging / Named entity recognition
  • Parallel corpus
  • Dialog corpus
  • Others
• Tutorial
• Research summary
• Reference
• Contributors

Python library

Morphology analysis

Libraries that split Japanese text into words or morphemes and assign part-of-speech and base forms

• sudachi.rs - SudachiPy 0.6* and above are developed as Sudachi.rs.
• Janome - Japanese morphological analysis engine written in pure Python
• mecab-python3 - mecab-python. you can find original version here:http://taku910.github.io/mecab/
• mecab - This repository is for building Windows 64-bit MeCab binary and improving MeCab Python binding.
• fugashi - A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.
• nagisa - A Japanese tokenizer based on recurrent neural networks
• pyknp - A Python Module for JUMAN++/KNP
• Mykytea-python - Python wrapper for KyTea
• konoha - Konoha: Simple wrapper of Japanese Tokenizers
• natto-py - natto-py combines the Python programming language with MeCab, the part-of-speech and morphological analyzer for the Japanese language.
• rakutenma-python - Rakuten MA (Python version)
• python-vaporetto - Vaporetto is a fast and lightweight pointwise prediction based tokenizer. This is a Python wrapper for Vaporetto.
• dango - An easy to use tokenizer for Japanese text, aimed at language learners and non-linguists
• rhoknp - Yet another Python binding for Juman++/KNP
• python-vibrato - Viterbi-based accelerated tokenizer (Python wrapper)
• jagger-python - Python binding for Jagger(C++ implementation of Pattern-based Japanese Morphological Analyzer)
• Mecari - Mecari (Japanese Morphological Analysis with Graph Neural Networks)

Name	downloads/week	total downloads	stars	last commit
🔗 SudachiPy	📥 313k	📦 75M	⭐ 443	🔴 october 2022
🔗 Janome	📥 43k	📦 14M	⭐ 918	🟡 june
🔗 mecab-python3	📥 133k	📦 42M	⭐ 579	🟡 november 2025
🔗 mecab	📥 68k	📦 3M	⭐ 274	🔴 october 2024
🔗 fugashi	📥 143k	📦 19M	⭐ 535	🟡 october 2025
🔗 nagisa	📥 46k	📦 10M	⭐ 422	🟢 september
🔗 pyknp	📥 531	📦 3M	⭐ 93	🟡 january
🔗 Mykytea-python	📥 606	📦 591k	⭐ 36	🟡 march
🔗 konoha	📥 33k	📦 7M	⭐ 265	🟢 last wednesday
🔗 natto-py	📥 2k	📦 34M	⭐ 95	🔴 november 2023
🔗 rakutenma-python	📥 11	📦 27k	⭐ 23	🔴 may 2017
🔗 python-vaporetto	📥 402	📦 192k	⭐ 21	🟡 may
🔗 dango	📥 25	📦 27k	⭐ 26	🔴 november 2021
🔗 rhoknp	📥 10k	📦 2M	⭐ 40	🟢 last tuesday
🔗 python-vibrato	📥 128	📦 128k	⭐ invalid	🟡 may
🔗 jagger-python	📥 1k	📦 339k	⭐ 13	🔴 march 2024
🔗 Mecari	-	-	⭐ 41	🔴 september 2025

Parsing

Libraries that analyze syntactic and dependency structures of Japanese sentences

• ginza - A Japanese NLP Library using spaCy as framework based on Universal Dependencies
• cabocha - Yet Another Japanese Dependency Structure Analyzer
• UniDic2UD - Tokenizer POS-tagger Lemmatizer and Dependency-parser for modern and contemporary Japanese
• camphr - Camphr - NLP libary for creating pipeline components
• SuPar-UniDic - Tokenizer POS-tagger Lemmatizer and Dependency-parser for modern and contemporary Japanese with BERT models
• depccg - A* CCG Parser with a Supertag and Dependency Factored Model
• bertknp - A Japanese dependency parser based on BERT
• esupar - Tokenizer POS-Tagger and Dependency-parser with BERT/RoBERTa/DeBERTa models for Japanese and other languages
• yomikata - Heteronym disambiguation library using a fine-tuned BERT model.
• jdepp-python - Python binding for J.DepP(C++ implementation of Japanese Dependency Parsers)
• lightblue - A CCG parser for Japanese with DTS-representations