7.1.18. 👍🏻 表库¶
7.1.18.1. 语言库¶
7.1.18.1.1. Node.js 和 Javascript¶
Node.js NLP 的库
Twitter-text - Twitter 的文本处理库的 JavaScript 实现
Knwl.js - JS 中的自然语言处理器
Retext - 用于分析和操纵自然语言的可扩展系统
NLP Compromise - 浏览器中的自然语言处理
Natural - 节点的一般自然语言设施
Poplar - 用于自然语言处理（NLP）的基于 Web 的注释工具
7.1.18.1.2. Python¶
Python NLP 库
TextBlob - Providing a consistent API for diving into common natural language processing (NLP) tasks. Stands on the giant shoulders of Natural Language Toolkit (NLTK) and Pattern, and plays nicely with both :+1:
spaCy - Industrial strength NLP with Python and Cython :+1:
textacy - Higher level NLP built on spaCy
gensim - Python library to conduct unsupervised semantic modelling from plain text :+1:
scattertext - Python library to produce d3 visualizations of how language differs between corpora
AllenNLP - An NLP research library, built on PyTorch, for developing state-of-the-art deep learning models on a wide variety of linguistic tasks.
PyTorch-NLP - NLP research toolkit designed to support rapid prototyping with better data loaders, word vector loaders, neural network layer representations, common NLP metrics such as BLEU
Rosetta - Text processing tools and wrappers (e.g. Vowpal Wabbit)
PyNLPl - Python Natural Language Processing Library. General purpose NLP library for Python. Also contains some specific modules for parsing common NLP formats, most notably for FoLiA, but also ARPA language models, Moses phrasetables, GIZA++ alignments.
jPTDP - A toolkit for joint part-of-speech (POS) tagging and dependency parsing. jPTDP provides pre-trained models for 40+ languages.
BigARTM - a fast library for topic modelling
Snips NLU - A production ready library for intent parsing
Chazutsu - A library for downloading&parsing standard NLP research datasets
Word Forms - Word forms can accurately generate all possible forms of an English word
Multilingual Latent Dirichlet Allocation (LDA) - A multilingual and extensible document clustering pipeline
NLP Architect - A library for exploring the state-of-the-art deep learning topologies and techniques for NLP and NLU
Flair - A very simple framework for state-of-the-art multilingual NLP built on PyTorch. Includes BERT, ELMo and Flair embeddings.
Kashgari - Simple, Keras-powered multilingual NLP framework, allows you to build your models in 5 minutes for named entity recognition (NER), part-of-speech tagging (PoS) and text classification tasks. Includes BERT and word2vec embedding.
7.1.18.1.3. C++¶
C++ 库
MIT Information Extraction Toolkit - C, C++, and Python tools for named entity recognition and relation extraction
CRF++ - Open source implementation of Conditional Random Fields (CRFs) for segmenting/labeling sequential data & other Natural Language Processing tasks.
CRFsuite - CRFsuite is an implementation of Conditional Random Fields (CRFs) for labeling sequential data.
BLLIP Parser - BLLIP Natural Language Parser (also known as the Charniak-Johnson parser)
colibri-core - C++ library, command line tools, and Python binding for extracting and working with basic linguistic constructions such as n-grams and skipgrams in a quick and memory-efficient way.
ucto - Unicode-aware regular-expression based tokenizer for various languages. Tool and C++ library. Supports FoLiA format.
libfolia - C++ library for the FoLiA format
frog - Memory-based NLP suite developed for Dutch: PoS tagger, lemmatiser, dependency parser, NER, shallow parser, morphological analyzer.
MeTA - MeTA : ModErn Text Analysis is a C++ Data Sciences Toolkit that facilitates mining big text data.
StarSpace - a library from Facebook for creating embeddings of word-level, paragraph-level, document-level and for text classification
7.1.18.1.4. Java¶
Java NLP 库
ReVerb Web-Scale Open Information Extraction
OpenRegex An efficient and flexible token-based regular expression language and engine.
CogcompNLP - Core libraries developed in the U of Illinois’ Cognitive Computation Group.
MALLET - MAchine Learning for LanguagE Toolkit - package for statistical natural language processing, document classification, clustering, topic modeling, information extraction, and other machine learning applications to text.
RDRPOSTagger - A robust POS tagging toolkit available (in both Java & Python) together with pre-trained models for 40+ languages.
7.1.18.1.5. Kotlin¶
Kotlin NLP 库
7.1.18.1.6. Scala¶
Scala NLP 库
Saul - Library for developing NLP systems, including built in modules like SRL, POS, etc.
ATR4S - Toolkit with state-of-the-art automatic term recognition methods.
tm - Implementation of topic modeling based on regularized multilingual PLSA.
word2vec-scala - Scala interface to word2vec model; includes operations on vectors like word-distance and word-analogy.
Epic - Epic is a high performance statistical parser written in Scala, along with a framework for building complex structured prediction models.
7.1.18.1.7. R¶
R NLP 库
text2vec - Fast vectorization, topic modeling, distances and GloVe word embeddings in R.
wordVectors - An R package for creating and exploring word2vec and other word embedding models
RMallet - R package to interface with the Java machine learning tool MALLET
dfr-browser - Creates d3 visualizations for browsing topic models of text in a web browser.
dfrtopics - R package for exploring topic models of text.
sentiment_classifier - Sentiment Classification using Word Sense Disambiguation and WordNet Reader
jProcessing - Japanese Natural Langauge Processing Libraries, with Japanese sentiment classification
7.1.18.1.8. Clojure¶
Clojure-openNLP - Natural Language Processing in Clojure (opennlp)
Infections-clj - Rails-like inflection library for Clojure and ClojureScript
postagga - A library to parse natural language in Clojure and ClojureScript
7.1.18.1.9. Ruby¶
7.1.18.1.10. Rust¶
whatlang — 基于三元组的自然语言识别库
snips-nlu-rs - 用于意图解析的生产就绪库
7.1.18.2. 服务¶
NLP 作为具有更高级功能的 API，例如 NER，主题标记等
Wit-ai - 应用和设备的自然语言界面
IBM Watson 的自然语言理解 - API 和 Github 演示
亚马逊领悟 - NLP 和 ML 套件涵盖了最常见的任务，如 NER，标记和情感分析
谷歌云自然语言 API - 至少 9 种语言的语法分析，NER，情感分析和内容标记包括英语和中文 (简体和繁体).
平行点 - 高级文本分析 API 服务，从情感分析到意图分析