Data loaders and abstractions for text and NLP
Industrial-strength Natural Language Processing (NLP)
The Classical Language Toolkit
ExtractThinker is a Document Intelligence library for LLMs
ReFT: Representation Finetuning for Language Models
The no-nonsense RAG chunking library
A natural language interface for computers
Stanford NLP Python library for many human languages
Semantic search and workflows for medical/scientific papers
Extract schema, statistics and entities from datasets
Data and tools for generating and inspecting OLMo pre-training data
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
A Heterogeneous Benchmark for Information Retrieval
Efficient Retrieval Augmentation and Generation Framework
An LLM-powered knowledge curation system that researches topics
Large Language Model Text Generation Inference
Superlinked is a Python framework for AI Engineers
A Repo For Document AI
The library to build & auto-optimize LLM applications
Trained models & code to predict toxic comments
Han Language Processing
Underthesea - Vietnamese NLP Toolkit
A full spaCy pipeline and models for scientific/biomedical documents
Efficient few-shot learning with Sentence Transformers
Neural Network Compression Framework for enhanced OpenVINO