All AI tools
Search by what you need done, then narrow down by price.
Showing 265–288 of 5,321 tools.
Instructor
library for structured LLM extraction in Python
Dify
LLMOps platform for creating and operating AI-native apps based on GPT-4
Lunary
Open-source platform for LLM chatbots and agents: observability, prompt management, testing & more
The Pile
a leaderboard of The Pile benchmark.
LMExamQA
a leaderboard that benchmarks foundation models with Language-Model-as-an-Examiner.
LLM Use Case Leaderboard
a leaderboard that features LLM use cases.
LLM Rankings
a leaderboard that compares LLMs for all prompts.
Indico LLM Leaderboard
Indico Data runs a monthly benchmarking exercise across providers (LLama, Azure OpenAI, Google, AWS Bedrock, and Indico trained discriminative standard language models RoBERTa and
Evaluating LLMs is a minefield
talk by Princeton professor Arvind Narayanan
LLM Evaluation at Scale – Airtrain
no-code batch compute platform for LLM evaluation and tuning workloads
Chatbot Arena
benchmarking LLMs through pairwise confrontation and evaluation
LLM Testing Guide
Comprehensive Strategies for Testing and Behavior Analysis by Kolena
TruLens for LLMs
Evaluate and Track LLM Applications
LLM Evaluation
research on evaluation of LLMs conducted by Microsoft Research and other collaborated institutes. (Updated at: 2023/10)
LiveBench
A Challenging, Contamination-Free LLM Benchmark
BrainSoup
multi-agent & multi-LLM client with RAG, multi-modality, automation, code interpreter, and sandboxed file system
Multi-Agent Research Outline
an interactive eBook that compiles an extensive collection of research papers on large language model (LLM)-based multi-agent systems
Fine-Tuner.ai
no code approach to build AI agents
ChatArena
building multi-agent environments for LLMs
BrainstormGPT
AI multi-agent problem solving
GPT Researcher
AI agents for insights and research
AI Town
a virtual town where AI characters live, chat and socialize.
AutoGen | Microsoft
multi-agent conversation framework as a high-level abstraction by Microsoft [github]
TailorTask
Automate any boring task, without code and without having to learn a new tool