TencentPretrain

Repository facts

Stars

1,094

Forks

148

Open issues and pull requests

44

Primary language

Python

License

Other license

Owner

Tencent · Organization

Created

Sep 26, 2022

Last push

Aug 4, 2024

Topics

• albert
• bart
• bert
• chinese
• classification
• clue
• elmo
• fine-tuning
• gpt
• gpt-2
• model-zoo
• natural-language-processing
• ner
• pegasus
• pre-training
• pytorch
• roberta
• t5
• unilm
• xlm-roberta

Rank #5,761 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 2,526

  Rank 2,526: dbiir/UER-py

  Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

  3,114 starsPythonApache-2.0Last push May 9, 2024

• 2,553

  Rank 2,553: guillaume-be/rust-bert

  Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

  3,084 starsRustApache-2.0Last push Jan 13, 2026

• 6,577

  Rank 6,577: explosion/curated-transformers

  🤖 A PyTorch library of curated Transformer models and their composable components

  890 starsPythonMITLast push Apr 17, 2024

• 5,065

  Rank 5,065: 920232796/bert_seq2seq

  pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。

  1,307 starsPythonApache-2.0Last push Jun 18, 2022

• 1,866

  Rank 1,866: CLUEbenchmark/CLUE

  中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

  4,287 starsPythonNo license file detectedLast push Feb 6, 2026

• 3,355

  Rank 3,355: lonePatient/BERT-NER-Pytorch

  Chinese NER(Named Entity Recognition) using BERT(Softmax, CRF, Span)

  2,236 starsPythonMITLast push Mar 11, 2023