Arena

Arena (formerly LMArena) is a community-driven AI model benchmarking and comparison platform. It enables users to evaluate and compare the real-world performance of cutting-edge models like GPT, Claude, Gemini, across tasks spanning text, vision, code, and more, through anonymous battles, user voting, and an Elo scoring system.

Outlier AI

Outlier AI is a remote-work platform that connects global experts with AI companies, training AI models through tasks such as data labeling and model evaluation, enabling professionals to earn flexible income by applying their expertise.

ChatHub AI

ChatHub AI is a platform that aggregates multiple mainstream large language models, allowing users to compare the responses of different models side by side on the same interface. It aims to improve decision-making efficiency, validate information, and reduce the risk of hallucinations from relying on a single model.

Arena AI

Arena AI provides two core solution directions: first, an AI model evaluation and routing platform that helps users discover and pick the right AI models through community voting and smart routing; second, an AI-powered community engagement platform that enables businesses to build and manage real-time interactive communities on their websites, boosting user engagement and conversions.

Arize AI

Arize AI is a lifecycle observability and evaluation platform for large language models (LLMs) and agents. It helps AI engineering teams monitor, evaluate, and optimize model performance to ensure application reliability and business impact.

Evidently AI

Evidently AI is an open-source platform focused on evaluating, testing, and monitoring machine learning and large language models, helping data scientists and engineers ensure the quality and reliability of AI systems in production.

Confident AI

Confident AI is a platform focused on evaluating and observability for large language models, helping engineers and product teams systematically test, monitor, and optimize the performance and reliability of their AI applications.

Ragas

Ragas is an open-source framework for automating the evaluation, monitoring, and improvement of Retrieval-Augmented Generation (RAG) system performance, helping developers implement repeatable, scalable, and systematic assessments.

Nexa AI

Nexa AI is a platform focused on on-device AI model deployment and optimization, offering a locally optimized model library and development tools for local devices. Its core value is to help developers and businesses run AI models efficiently on-device, with support for offline use and a strong emphasis on data privacy.

Future AGI

Future AGI is an enterprise-grade platform for LLM observability and evaluation optimization, focused on helping AI agents and applications improve accuracy, reliability and performance. The platform unifies building, evaluation, optimization, and observability into a single solution, accelerating the development and deployment cycle of high-precision AI applications with automated tooling.

Transluce AI

Transluce AI is an open-source research toolkit focused on improving the interpretability and safety of AI systems, helping researchers and developers understand, debug, and monitor the internal behaviors of AI models, and advance responsible AI.

Humanloop

Humanloop is an enterprise-grade AI development platform that provides end-to-end tooling for building, evaluating, optimizing, and deploying applications powered by large language models (LLMs). By integrating prompt engineering, model evaluation, and observability, it helps teams improve the reliability and performance of AI apps and supports cross-functional collaboration and secure deployment.

phospho AI

phospho AI is an open-source text analysis platform designed for large language model (LLM) applications. It automatically analyzes text interactions between users and AI applications, extracts key events and user intents, and provides data visualization tools to help developers optimize conversational experiences and model performance.

Alle-AI

Alle-AI is a one-stop aggregation platform that brings together multiple leading AI models. It enables parallel invocation, comparison, and integration of generative AI tools from different vendors, with the aim of boosting creative efficiency and output reliability.

Enigma AI

Enigma AI is a comprehensive umbrella for a range of AI applications and research, including decision-generation systems, large language model evaluation benchmarks, EEG decoding models, and intelligent chat applications. It provides diverse AI tools and solutions for users across various domains, spanning content creation, code writing, advanced reasoning evaluation, and neuroscience research.

Captum

Captum is an open-source model interpretability library for PyTorch that helps developers understand the prediction logic and feature contributions of neural network models. It is suitable for model debugging, algorithm research, and performance optimization.

Thisorthis.ai

Thisorthis.ai is a one-stop platform for comparing and evaluating generative AI models. By testing models side by side across multiple dimensions, it helps users efficiently identify the AI model that best fits their task requirements.

Atla AI

Atla AI is an automation platform designed for AI agents to evaluate and improve performance. Through systematic analysis, monitoring, and optimization tools, it helps developers enhance agent performance, reliability, and development efficiency.

OverallGPT Compare AI

OverallGPT Compare AI is an online platform for comparing the performance of AI large models. It lets users run side-by-side visual comparisons of responses from different AI models, helping developers, researchers, and technology decision-makers evaluate and select the AI model that best fits their needs.

Langtrace AI

Langtrace AI is an open-source observability and evaluation platform that helps developers monitor, debug, and optimize applications built on large language models, turning AI prototypes into reliable enterprise-grade products.