Natural Language Processing

Python packages that support NLP: Processing and interpreting human languages.

Features currently being evaluated

FeatureDescription
Chinese support Processes Chinese language text.
Package jieba funNLP spaCy gensim nltk Pattern PyText SnowNLP StanfordNLP langid.py PyTorch-NLP Polyglot HarvestText pkuseg-python
Package jieba funNLP spaCy gensim nltk Pattern PyText SnowNLP StanfordNLP langid.py PyTorch-NLP Polyglot HarvestText pkuseg-python
Description 结巴中文分词 中英文敏感词、语言检测、中外手机/电话归属地/运营商查询、名字推断性别、手机号抽取、身份证抽取、邮箱抽取、中日文人名库、中文缩写库、拆字词典、词汇情感值、停用词、反动词表、暴恐词表、繁简体转换、英文模拟中文发音、汪峰歌词生成器、职业名称词库、同义词库、反义词库、否定词库、汽车品牌词库、汽车零件词库、连续英文切割、各种中文词向量、公司名字大全、古诗词库、IT词库、财经词库、成语词库、地名词库、历史名人词库、诗词词库、医学词库、饮食词库、法律词库、汽车词库、动物词库、中文聊天语料、中文谣言数据、百度中文问答数据集、句子相似度匹配算法集合、bert资源、文本生成&摘要相关工具、cocoNLP信息抽取工具、国内电话号码正则匹配、清华大学XLORE:中英文跨语言百科知识图谱、清华大学人工智能技术系列报告、自然语言生成、NLU太难了系列、自动对联数据及机器人、用户名黑名单列表、罪名法务名词及分类模型、微信公众号语料、cs224n深度学习自然语言处理课程、中文手写汉字识别、中文自然语言处理
语料/数据集、变量命名神器、分词语料库+代码、任务型对话英文数据集、ASR
语音数据集 +
基于深度学习的中文语音识别系统、笑声检测器、Microsoft多语言数字/单位/如日期时间识别包、中华新华字典数据库及api(包括常用歇后语、成语、词语和汉字)、文档图谱自动生成、SpaCy
中文模型、Common
Voice语音识别数据集新版、神经网络关系抽取、基于bert的命名实体识别、关键词(Keyphrase)抽取包pke、基于医疗领域知识图谱的问答系统、基于依存句法与语义角色标注的事件三元组抽取、依存句法分析4万句高质量标注数据、cnocr:用来做中文OCR的Python3包、中文人物关系知识图谱项目、中文nlp竞赛项目及代码汇总、中文字符数据、speech-aligner:
从“人声语音”及其“语言文本”产生音素级别时间对齐标注的工具、AmpliGraph:
知识图谱表示学习(Python)库:知识图谱概念链接预测、Scattertext
文本可视化(python)、语言/知识表示工具:BERT &
ERNIE、中文对比英文自然语言处理NLP的区别综述、Synonyms中文近义词工具包、HarvestText领域自适应文本挖掘工具(新词发现-情感分析-实体链接等)、word2word:(Python)方便易用的多语言词-词对集:62种语言/3,564个多语言对、语音识别语料生成工具:从具有音频/字幕的在线视频创建自动语音识别(ASR)语料库、构建医疗实体识别的模型(包含词典和语料标注)、单文档非监督的关键词抽取、Kashgari中使用gpt-2语言模型、开源的金融投资数据提取工具、文本自动摘要库TextTeaser:
仅支持英文、人民日报语料处理工具集、一些关于自然语言的基本模型、基于14W歌曲知识库的问答尝试--功能包括歌词接龙and已知歌词找歌曲以及歌曲歌手歌词三角关系的问答、基于Siamese
bilstm模型的相似句子判定模型并提供训练数据集和测试数据集、用Transformer编解码模型实现的根据Hacker
News文章标题自动生成评论、用BERT进行序列标记和文本分类的模板代码、LitBank:NLP数据集——支持自然语言处理和计算人文学科任务的100部带标记英文小说语料、百度开源的基准信息抽取系统、虚假新闻数据集、Facebook:
LAMA语言模型分析,提供Transformer-XL/BERT/ELMo/GPT预训练语言模型的统一访问接口、CommonsenseQA:面向常识的英文QA挑战、中文知识图谱资料、数据及工具、各大公司内部里大牛分享的技术文档
PDF 或者
PPT、自然语言生成SQL语句(英文)、中文NLP数据增强(EDA)工具、英文NLP数据增强工具
、基于医药知识图谱的智能问答系统、京东商品知识图谱、基于mongodb存储的军事领域知识图谱问答项目、基于远监督的中文关系抽取、语音情感分析、中文ULMFiT-情感分析-文本分类-语料及模型、一个拍照做题程序、世界各国大规模人名库、一个利用有趣中文语料库
...
💫 Industrial-strength Natural
Language Processing (NLP) with
Python and Cython
Topic Modelling for Humans NLTK Source Web mining module for Python,
with tools for scraping,
natural language processing,
machine learning, network
analysis and visualization.
A natural language modeling
framework based on PyTorch
Python library for processing
Chinese text
Official Stanford NLP Python
Library for Many Human
Languages
Stand-alone language
identification system
Supporting Rapid Prototyping
with a Toolkit (incl. Datasets
and Neural Network Layers)
Multilingual text (NLP)
processing tool...
文本挖掘和预处理工具(文本清洗、新词发现、情感分析、实体识别链接、句法分析等),无监督或弱监督(种子词)方法 A toolkit for Chinese word
segmentation in various
domains.
CategoryInstallable PackageInstallable PackageInstallable PackageInstallable PackageInstallable PackageInstallable PackageInstallable PackageInstallable PackageInstallable PackageInstallable PackageInstallable PackageInstallable PackageInstallable PackageInstallable Package
# Using This00000000000000
Python 3?
Development Status Unknown n/a Production/Stable n/a Production/Stable Production/Stable Unknown Alpha Beta n/a Beta Beta Unknown n/a
Last updated Jan. 13, 2020, 8:24 a.m. Jan. 20, 2020, 1:44 a.m. Sept. 19, 2019, 11:38 a.m. Jan. 7, 2020, 10:53 p.m. Sept. 17, 2019, 9:01 p.m. Aug. 18, 2018, 1:18 p.m. Sept. 19, 2019, 7:48 p.m. May 19, 2017, 4:50 a.m. July 31, 2019, 8:08 p.m. July 14, 2017, 10:49 p.m. Aug. 19, 2019, 8:08 p.m. March 29, 2018, 1:50 p.m. Jan. 20, 2020, 2:20 a.m.
Version0.42n/a2.2.3n/a3.4.53.60.3.10.12.30.2.0n/a0.5.016.7.40.6.0n/a
RepoGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithub
Commits
Stars2164616439146081035881587136537443102409151214431371408n/a
Repo Forks545649242524368422001403614108929825316825094n/a
Participantsfxsjy
gumblex
cloudaice
walkskyer
ZoeyYoung
fukuball
JesseyXujin
sing1ee
hermanschaaf
yanyiwu
more...
fighting41love
imhuster
wainshine
CasterWx
ZheZhaoRUC
BrikerMan
sty945
yunfei-shi
honnibal
ines
syllog1sm
svlandeg
henningpeters
maxirmx
geovedi
jimregan
oroszgy
adrianeboyd
more...
piskvorky
tmylk
menshikh-iv
chinmayapancholi13
gojomo
mpenkov
cscorley
sotte
jayantj
ziky90
more...
stevenbird
alvations
dhgarrette
kmike
fievelk
Copper-Head
wroberts
dimazest
heatherleaf
ewan-klein
more...
tom-de-smedt
markus-beuckelmann
Xsardas1000
napsternxg
sloria
fdb
frederik-elwert
jgrivolla
kkoch986
newworldorder
more...
Titousensei
seayoung1112
chenyangyu1988
borguz
mwu1993
bethebunny
hikushalhere
geof90
shreydesai
snisarg
more...
isnowfy
HenryChanhy
zengliangju
bryant1410
erning
duanguoxue
mozillazg
J38
qipeng
yuhaozhang
arunchaganty
mihail911
vzhong
manning
lwolfsonkin
dan-zheng
0xflotus
more...
saffsd
aitzol
jnothman
Paczesiowa
martinth
pquentin
PetrochukM
floscha
zbyte64
benjamin-work
grant
songheony
rishishian
JiaqiLiu
nzw0301
XingxingZhang
aboSamoor
alantian
adamhadani
vtsuei2
phanein
janissl
mhnnunes
syscmp
ziliwang
dchaplinsky
more...
blmoistawinde
Sean16SYSU
Documentation N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
Chinese support
Search WeightPackageDescriptionLast PyPI release:Repo ForksStars
{{ item.weight / max_weight * 100 | number:0 }}%{{ item.title }}Grid: {{ item.description }} {{ item.last_released | date: 'mediumDate' }} N/A {{ item.repo_forks }} N/A {{ item.repo_watchers }} N/A