:zap: From finding text to search and replace, from sorting to beautifying text and more :art:

PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.

Diff Match Patch is a high-performance library in multiple languages that manipulates plain text.

Intuitive find & replace CLI (sed alternative)

fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.

Python library for creating PEG parsers

Text Classification Algorithms: A Survey

Persian NLP Toolkit

A fast and convenient fuzzy matcher library for rust

The most accurate natural language detection library for Go, suitable for short text and mixed-language text

A fast implementation of Aho-Corasick in Rust.

Program to convert lines of text into a tree structure.

Thai natural language processing in Python

All-in-one text de-duplication

A sharp cut(1) clone.

Text Normalization & Inverse Text Normalization

A simple Python module for parsing human names into their individual components

Natural language detection library for Go

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

Open Korean Text Processor - An Open-source Korean Text Processor

High performance and CommonMark compliant HTML to Markdown converter. Maintained by the Kreuzberg team. Kreuzberg is a fast, polyglot document intelligence engine with a Rust core. It extracts structured data from 56+ document formats using streaming parsers and built-in OCR.

Turn PDFs and EPUBs into audiobooks, subtitles or videos into dubbed videos (including translation), and more. For free. Pandrator uses local models, notably XTTS, including voice-cloning (instant, RVC-enhanced, XTTS fine-tuning) and LLM processing. It aspires to be a user-friendly app with a GUI, an installer and all-in-one packages.

SQL Runtime without any database

pyarabic

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).

Automatic Korean word spacing with Python

Simple SQL-like syntax on top of Perl text processing.

🗣️ Tool to generate adversarial text examples and test machine learning models against them

A low level regular expression library that uses deterministic finite automata.

Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku, and Zenkaku