203 results for “topic:chinese-nlp”
AirLLM 70B inference with single 4GB GPU
:orange_book: 中华新华字典数据库。包括歇后语，成语，词语，汉字。
大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP
BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）
A curated list of resources for Chinese NLP 中文自然语言处理相关资料
Language Technology Platform
Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系，成为中文AIGC和认知智能的基础设施。
MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。
百度NLP：分词，词性标注，命名实体识别，词重要性
fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.
Chinese-LLaMA 1&2、Chinese-Falcon 基础模型；ChatFlow中文对话模型；中文OpenLLaMA模型；NLP预训练/指令微调数据集
Chinese Named Entity Recognition with IDCNN/biLSTM+CRF, and Relation Extraction with biGRU+2ATT 中文实体识别与关系提取
An Efficient Lexical Analyzer for Chinese
Datasets, SOTA results of every fields of Chinese NLP
百度开源的依存句法分析系统
Jcseg is a light weight NLP framework developed with Java. Provide CJK and English segmentation based on MMSEG algorithm, With also keywords extraction, key sentence extraction, summary extraction implemented based on TEXTRANK algorithm. Jcseg had a build-in http server and search modules for lucene,solr,elasticsearch,opensearch
Collections of Chinese NLP corpus
An open-source educational chat model from ICALK, East China Normal University. 开源中英教育对话大模型。(通用基座模型，GPU部署，数据清理) 致敬: LLaMA, MOSS, BELLE, Ziya, vLLM
:four_leaf_clover: Another Chinese chatbot implemented in PyTorch, which is the sub-module of intelligent work order processing robot. 👩🔧
zhparser is a PostgreSQL extension for full-text search of Chinese language
An Efficient Lexical Analyzer for Chinese
SpaCy 中文模型 | Models for SpaCy that support Chinese
[COLING 2022] CSL: A Large-scale Chinese Scientific Literature Dataset 中文科学文献数据集
Rime Cantonese input schema | 中州韻粵語拼音輸入方案
微信公众号语料库
Some useful Chinese corpus datasets 中文语料小数据
AdaSeq: An All-in-One Library for Developing State-of-the-Art Sequence Understanding Models
chinese NLP corpus of chinese science fiction,chinese science fiction corpus : About 4675 Chinese science fiction novels 大约有4675本科幻小说，中文科幻小说自然语言处理语料库，中文科幻小说文本语料库，中文科幻小说文本数据库，科幻小说语料
Photographing Chinese-Address OCR implemented using CTPN+CTC+Address Correction. 拍照文档中文地址文字识别。
An Efficient Lexical Analyzer for Chinese