appleyc Goto Github PK

langid.py

Stand-alone language identification system

leetcode

lightseq

LightSeq: A High Performance Library for Sequence Processing and Generation

llama-factory

Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)

llmspracticalguide

A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

mosesdecoder

Moses, the machine translation system

mtbook

《机器翻译：基础与模型》肖桐 朱靖波 著 - Machine Translation: Foundations and Models

named_entity_recognition

中文命名实体识别（包括多种模型：HMM，CRF，BiLSTM，BiLSTM+CRF的具体实现）

neural-punctuator

Complimentary code for our paper Automatic punctuation restoration with BERT models

nlp_chinese_corpus

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

nlprule

A fast, low-resource Natural Language Processing and Text Correction library written in Rust.

nltk

NLTK Source

openbilibili

存档

opencc

Conversion between Traditional and Simplified Chinese

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

pinyin

汉字转拼音，支持20870个汉字，包含完整的多音字

polyglot

Polyglot: Large Language Models of Well-balanced Competence in Multi-languages

punctuator

An LSTM RNN for restoring missing punctuation in unsegmented text.

punctuator2

A bidirectional recurrent neural network model with attention mechanism for restoring missing punctuation in unsegmented text

py-googletrans

(unofficial) Googletrans: Free and Unlimited Google translate API for Python. Translates totally free of charge.

pycorrector

pycorrector is a toolkit for text error correction. 文本纠错，Kenlm，ConvSeq2Seq，BERT，MacBERT，ELECTRA，ERNIE，Transformer，T5等模型实现，开箱即用。

pykospacing

Automatic Korean word spacing with Python

python-pinyin

汉字转拼音(pypinyin)

real-url

获取斗鱼&虎牙&哔哩哔哩&抖音&快手等 58 个直播平台的真实流媒体地址(直播源)和弹幕，直播源可在 PotPlayer、flv.js 等播放器中播放。

sacremoses

Python port of Moses tokenizer, truecaser and normalizer

simbert

a bert for retrieval and generation

software-documentation-data-set-for-machine-translation

A parallel evaluation data set of SAP software documentation with document structure annotation

stablelm

StableLM: Stability AI Language Models

subword-nmt

Unsupervised Word Segmentation for Neural Machine Translation and Text Generation

text-to-text-transfer-transformer

Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"