Public Notes by reorx Tagged #evaluation

Braintrust - Ship LLM products that work www.braintrust.dev

The end-to-end platform for building world-class AI products

via: https://www.aiengineerpack.com/

#llm #evaluation #platform

langfuse/langfuse: 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23 github.com

🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23 - langfuse/langfuse: 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

#llmops #llm #evaluation #prompt-engineering #self-hosted #platform #tracing #monitoring #rag

adaline www.adaline.ai

Iterate, evaluate, deploy, and monitor prompts for LLMs

#llm #prompt #iteration #evaluation #testing

evaluation •
iteration •
llm •
prompt •
testing

lm-sys/FastChat: An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena. github.com

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena. - lm-sys/FastChat

#llm #api #evaluation #chat

api •
chat •
evaluation •
llm

explodinggradients/ragas: Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines github.com

relari-ai/continuous-eval: Open-Source Evaluation for GenAI Application Pipelines github.com

ai •
debugging •
evaluation •
llm •
pipeline •
python •
rag

silentmatt/expr-eval: Mathematical expression evaluator in JavaScript github.com

Mathematical expression evaluator in JavaScript. Contribute to silentmatt/expr-eval development by creating an account on GitHub. #javascript #math #evaluation #library