Dummy Run
Get started

Get started

Install Dummy Run, run one persona against a site without changing anything, and look at the run in Grafana.

What you need

  • Go 1.27.1 or later
  • Firefox, or Chrome with a matching chromedriver
  • A model provider. The steps below use an Azure OpenAI deployment signed in with az login. Other providers also work, and the provider guide lists what each needs
  • Docker, for the local Grafana
  • A clone of the repository, for the example cast
git clone https://github.com/dummy-run/dummy-run.git
cd dummy-run

1. Install the commands

dummyrun plays a persona. dummyrun-otel sends the run to an OpenTelemetry backend.

go install github.com/dummy-run/dummy-run/cmd/dummyrun@latest
go install github.com/dummy-run/dummy-run/integrations/grafana/exporter/cmd/dummyrun-otel@latest

Check that both are on your path.

dummyrun version
dummyrun-otel version

2. Run one persona

The example cast visits dummyrun.dev. The target file sets "read_only": true, so the browser blocks every request that could change data and every request to another host.

export DUMMYRUN_AZURE_ENDPOINT=https://<resource>.openai.azure.com
dummyrun run --cast casts/dummyrun-dev --persona tom-developer --scenario find-the-quickstart \
  --target examples/targets/dummyrun-dev.json --out ~/.local/share/dummyrun/runs/dummyrun-dev \
  --browser firefox --provider azure --model <deployment> --region uksouth

The run ends with a JSON record, the persona’s own report and a screenshot for each step. To test your own site, copy examples/targets/dummyrun-dev.json and change base_url and allowed_hosts. To use another provider, change --provider, --model and the sign-in. The command line reference lists every flag.

3. Look at it in Grafana

docker run --rm -p 127.0.0.1:4318:4318 -p 127.0.0.1:3000:3000 grafana/otel-lgtm:0.35.0
dummyrun-otel export ~/.local/share/dummyrun/runs/dummyrun-dev

Open http://localhost:3000 and sign in as admin with the password admin. Pick Explore, choose Loki and query {service_name="dummyrun"} over the last 7 days. Each line links to its trace. To see Grafana without a model deployment, export the example records with dummyrun-otel export examples/runs.

4. Read the record

Every record follows the run record schema. The page lists each field and shows a full example. The Grafana guide covers the dashboards and alerts.

Sources

The install and run commands are in docs/ENGINE.md, code. The export commands are in integrations/grafana/exporter/README.md, code. The read-only behaviour is the engine’s request interception, code.