Stateful inference infrastructure

Build agents that improve from every run

Reef records inference, connects feedback to the exact artifact that served it, and safely publishes the next version—without redeploying your harness.

One traceable loop from request to artifact

Harnesses keep ownership of conversations, tools, and environments. Reef owns the versioned learning state behind inference.

Explore the architecture
  1. 1Resolve the scenario and its current artifact
  2. 2Serve a provider-native inference request
  3. 3Collect reports, events, and rewards
  4. 4Train, publish, and serve the next artifact version

From checkout to a healthy Reef service

Start locally, bind a scenario, and send the first provider-native request. The guide explains every step and expected result.

Follow the 5-minute guide
export REEF_TOKEN="$(openssl rand -hex 16)"
reef serve -c reef/configs/inference-local-sglang.yaml

curl http://localhost:8900/healthz

Keep the reference close when you need it