Arthur Bench Files

Bench is a tool for evaluating LLMs for production use cases

This is an exact mirror of the Arthur Bench project, hosted at https://github.com/arthur-ai/bench. SourceForge is not affiliated with Arthur Bench.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
0.3.1	2024-02-16		0
0.3.0	2023-12-20		0
0.2.3	2023-10-11		0
0.2.2rc1	2023-09-29		0
0.2.1	2023-08-17		0
Totals: 5 Items			0

Other Useful Business Software

Secure User Management, Made Simple | Frontegg

Get 7,500 MAUs, 50 tenants, and 5 SSOs free – integrated into your app with just a few lines of code.

Frontegg powers modern businesses with a user management platform that’s fast to deploy and built to scale. Embed SSO, multi-tenancy, and a customer-facing admin portal using robust SDKs and APIs – no complex setup required. Designed for the Product-Led Growth era, it simplifies setup, secures your users, and frees your team to innovate. From startups to enterprises, Frontegg delivers enterprise-grade tools at zero cost to start. Kick off today.

Start for Free

Windocks - Docker Oracle and SQL Server Containers

Deliver faster. Provision data for AI/ML. Enhance data privacy. Improve quality.

Windocks is a leader in cloud native database DevOps, recognized by Gartner as a Cool Vendor, and as an innovator by Bloor research in Test Data Management. Novartis, DriveTime, American Family Insurance, and other enterprises rely on Windocks for on-demand database environments for development, testing, and DevOps. Windocks software is easily downloaded for evaluation on standard Linux and Windows servers, for use on-premises or cloud, and for data delivery of SQL Server, Oracle, PostgreSQL, and MySQL to Docker containers or conventional database instances.

Learn More

Secure User Management, Made Simple | Frontegg

Get 7,500 MAUs, 50 tenants, and 5 SSOs free – integrated into your app with just a few lines of code.

Start for Free

Recommended Projects

openbench
Provider-agnostic, open-source evaluation infrastructure
GLM-4.7
Advanced language and coding AI model
DeepEval
DeepEval is a simple-to-use, open-source LLM evaluation framework, for evaluating and testing large-language model systems. It is similar to Pytest but specialized for unit testing LLM outputs. DeepEval incorporates the latest research to evaluate LLM outputs based on metrics such as G-Eval, hallucination, answer relevancy, RAGAS, etc., which uses LLMs and various other NLP models that run locally on your machine for evaluation. Whether your application is implemented via RAG or fine-tuning, LangChain, or LlamaIndex, DeepEval has you covered. With it, you can easily determine the optimal hyperparameters to improve your RAG pipeline, prevent prompt drifting, or even transition from OpenAI to hosting your own Llama2 with confidence.
OpenLLM
Operating LLMs in production
Opik
Debug, evaluate, and monitor your LLMapps, RAG systems, and agentic AI

Arthur Bench Files

Bench is a tool for evaluating LLMs for production use cases

Get an email when there's a new version of Arthur Bench