llm-colosseum

Repository facts

Stars

1,483

Forks

181

Open issues and pull requests

16

Primary language

Jupyter Notebook

License

MIT License (MIT)

Owner

OpenGenerativeAI · Organization

Created

Mar 23, 2024

Last push

Mar 21, 2025

Topics

• benchmark
• genai
• llm
• streetfighterai

Rank #4,615 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 4,321

  Rank 4,321: NirDiamant/Controllable-RAG-Agent

  This repository provides an advanced Retrieval-Augmented Generation (RAG) solution for complex question answering. It uses sophisticated graph based algorithm to handle the tasks.

  1,629 starsJupyter NotebookApache-2.0Last push Oct 10, 2026

• 9,486

  Rank 9,486: NisaarAgharia/Advanced_RAG

  Advanced Retrieval-Augmented Generation (RAG) through practical notebooks, using the power of the Langchain, OpenAI GPTs ,META LLAMA3 ,Agents.

  502 starsJupyter NotebookNo license file detectedLast push Apr 26, 2024

• 1,082

  Rank 1,082: open-compass/opencompass

  OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, rea…

  7,527 starsPythonApache-2.0Last push Oct 16, 2026

• 2,441

  Rank 2,441: xlang-ai/OSWorld

  [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

  3,217 starsPythonApache-2.0Last push Sep 14, 2026

• 3,256

  Rank 3,256: beir-cellar/beir

  A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

  2,311 starsPythonApache-2.0Last push Oct 16, 2025

• 3,329

  Rank 3,329: sierra-research/tau2-bench

  τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

  2,256 starsPythonMITLast push Oct 16, 2026