XPretrain

Repository facts

Stars

512

Forks

35

Open issues and pull requests

16

Primary language

Python

License

Other license

Owner

microsoft · Organization

Created

Mar 15, 2022

Last push

Aug 28, 2026

Topics

• computer-vision
• multimedia
• multimodal-learning
• nlp
• pre-training

Rank #9,389 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 4,292

  Rank 4,292: invictus717/MetaTransformer

  Meta-Transformer for Unified Multimodal Learning

  1,643 starsPythonApache-2.0Last push Dec 5, 2023

• 975

  Rank 975: bytedeco/javacv

  Java interface to OpenCV, FFmpeg, and more

  8,347 starsJavaOther licenseLast push Aug 12, 2026

• 6,770

  Rank 6,770: pipeless-ai/pipeless

  An open-source computer vision framework to build and deploy apps in minutes

  855 starsRustApache-2.0Last push May 8, 2024

• 8,495

  Rank 8,495: Fabric-Project/Fabric

  Node Creative Coding / 3D / Image Processing tool inspired by Quartz Composer

  603 starsSwiftBSD-3-ClauseLast push Oct 17, 2026

• 6,230

  Rank 6,230: brightmart/bert_language_understanding

  Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

  968 starsPythonNo license file detectedLast push Jan 1, 2019

• 8,146

  Rank 8,146: princeton-nlp/LLM-Shearing

  [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning

  643 starsPythonMITLast push Mar 4, 2024