keepUpAI
CoursesLeaderboardGuidesInvitePricing
Start freeYou
HomeGlossaryEvals (LLM Evaluation)

AI glossary

What is Evals?

Tests for AI behavior: datasets of realistic inputs plus graders that score outputs, run on every change.

Graders can be code-based checks, LLM-as-judge rubrics or human review. Evals catch regressions when prompts or models change.

▶Practice it hands-onEvals: Testing LLM Systems

Related terms

LLM-as-Judge

← All 43 AI terms

keepUpAI

Hands-on AI engineering practice for students, developers and career-changers. Learn by doing, one fun step at a time.

Courses

  • All lessons
  • Foundations
  • Prompting & LLM APIs
  • Retrieval (RAG)
  • Agents
  • Evals & Production
  • ML for AI Engineers
  • Build an AI SaaS

Guides

  • All guides
  • How to Learn AI Engineering in 2026
  • What Is an AI Engineer
  • What Is RAG (Retrieval-Augmented Generation)
  • Prompt Engineering Guide
  • What Are AI Agents
  • What Is MCP (Model Context Protocol)

Glossary

  • All AI terms
  • RAG
  • Embedding
  • AI Agent
  • Prompt Injection
  • Temperature
  • MCP

keepUp AI

  • Leaderboard
  • Free tools
  • LLM cost calculator
  • Token counter
  • AI Engineer Toolkit
  • AI vs ML vs SWE
  • Pricing
  • Invite friends
© 2026 keepUp AI · Learn AI engineering by doing · Privacy · Terms