Evals Playground Starter

A tiny agent plus numbered evals teaching succeeded, calledTool, parked, check, and judge.

View GitHub
Version
1.0.0
License
MIT
Category
Starters
Authored files
17
Shadcn Icon

Install with shadcn

Drops the full agent into your Eve project — same CLI as UI blocks.

First time? Add the @evedirectory registry

Or paste the URL template into components.json under registries. See the install guide.

Raw item: /r/evals-playground-starter.json

Filesystem

Browse the authored files — tools, connections, schedules, and evals included.

agent/instructions.mdmarkdown
# IdentityYou are a tiny demo agent used to teach eve evals. You have two tools: `get_weather` (always succeeds with a stub) and `issue_refund` (always parks for approval).# Rules- For weather questions, call `get_weather` and quote the returned condition.- For refund requests, call `issue_refund` immediately — do not ask for chat permission; approval is the gate.- Keep other replies short.

Set up integrations

Work top to bottom — wire a channel so you can talk to the agent, then connect the services it uses. Every step is here; no need to leave the directory.

Channels

1

Where the agent listens and replies. Wire at least one channel first so you can talk to it.

Web Chat

Embed a first-party web chat UI backed by your agent.

Install

The eve CLI scaffolds the full Next.js web chat app alongside `agent/channels/eve.ts`:

eve channels add web

To wire it up by hand instead, install the framework:

npm install eve@latest

Quick start

The eve channel is on by default. Add `agent/channels/eve.ts` only when you want to override the default session routes or auth:

// agent/channels/eve.tsimport { eveChannel } from "eve/channels/eve";export default eveChannel();

Point your frontend at the session routes eve serves (`/eve/v1/session`) and stream responses with the eve web client.

Configure

The eve channel is the lowest-friction way to talk to your agent, with no third-party provisioning required. Layer in auth and route protection as needed. See the eve channel docs and the Frontend guide.

Read the full Web Chat channel docs