Google Cloud

Gen AI Evaluation Service

Managed Google Cloud service for evaluating generative models and agents with adaptive rubrics, judge models and trajectory metrics.

ProprietaryPython

What it supports

  • Evaluates multi-step agents and tool calls: supportedEvaluates multi-step agents and tool callsDocs
  • LLM as a judge scoring: supportedLLM as a judge scoringDocs
  • ?Tracing: not yet verifiedTracing
  • ?Runs in CI: not yet verifiedRuns in CI

Links

Official documentationHosted option: Gemini Enterprise Agent Platform (formerly Vertex AI)Pricing

Other eval frameworks

Inspect AIpromptfooDeepEvalPydantic EvalsHarborLangfuseOpikMLflow GenAI EvaluationArize PhoenixW&B WeaveRagasGoogle ADK EvaluationBraintrustLangSmith EvaluationMicrosoft Foundry Evaluations

Get the weekly agent stack update

New official MCP servers, spec changes and harness releases, checked against the source. One email a week, no fluff.

Reviewed Oct 9, 2026.