Skip to content
This repository has been archived by the owner on Oct 27, 2023. It is now read-only.

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
Nicole White authored Aug 2, 2023
1 parent 8d16d68 commit 85b0f37
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

This repository demonstrates how to integrate LLM chain replays into your code review process. It contains:

* a [`simpleaichat`](https://github.com/minimaxir/simpleaichat) application that uses the [Autoblocks Python SDK](https://github.com/autoblocksai/python-sdk) to send events to the Autoblocks API
* a [`simpleaichat`](https://github.com/minimaxir/simpleaichat) application that uses the [Autoblocks Python SDK](https://pypi.org/project/autoblocksai/) to send events to the Autoblocks API
* a GitHub Actions workflow that **replays** real, past events from end users on every push to a feature branch

With our GitHub integration enabled, your teammates are not only reviewing your code, but also the impact that code will have on your LLM chains, and therefore your end users.
Expand Down Expand Up @@ -75,7 +75,7 @@ In another terminal, set the `AUTOBLOCKS_API_KEY` environment variable:
export AUTOBLOCKS_API_KEY=my-api-key
```

Then replay traces from a view:
Then, replay traces from a view:

```bash
poetry run replay --view-id clkeamsei0001l908cmjjtqrf --num-traces 3
Expand Down

1 comment on commit 85b0f37

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Autoblocks Replay Results

Trace 1d3baf6c-2928-459d-845d-dec611b5d140

Replay Inputs

request.payload - cvsy500a8blezkts8ebbsshh

{
  "query": "Alcatraz Island"
}

Replay Outputs

Message Original Replay Difference
request.payload Original Replay +0 / -0
ai.intermediate.request Original Replay +0 / -0
ai.intermediate.response Original Replay +0 / -0
ai.tool.selected Original Replay +0 / -0
ai.tool.response Original Replay +2 / -2
ai.intermediate.request Original Replay +1 / -1
ai.intermediate.response Original Replay +3 / -3
ai.final.response Original Replay +3 / -3
request.response Original Replay +1 / -1
--- ALL --- Original Replay +10 / -10

Trace a3be7623-be9e-45a0-93d8-7edd7beeccb6

Replay Inputs

request.payload - in3ym5sjrsqjqhjeayr8yqx6

{
  "query": "San Francisco tourist attractions"
}

Replay Outputs

Message Original Replay Difference
request.payload Original Replay +0 / -0
ai.intermediate.request Original Replay +0 / -0
ai.intermediate.response Original Replay +0 / -0
ai.tool.selected Original Replay +0 / -0
ai.tool.response Original Replay +2 / -2
ai.intermediate.request Original Replay +1 / -1
ai.intermediate.response Original Replay +3 / -3
ai.final.response Original Replay +3 / -3
request.response Original Replay +1 / -1
--- ALL --- Original Replay +10 / -10

Trace 3db671ca-5462-418b-bbdf-ed07bb375584

Replay Inputs

request.payload - b5svpjqmnip44seqz2113hep

{
  "query": "Highest points in the world"
}

Replay Outputs

Message Original Replay Difference
request.payload Original Replay +0 / -0
ai.intermediate.request Original Replay +0 / -0
ai.intermediate.response Original Replay +0 / -0
ai.tool.selected Original Replay +0 / -0
ai.tool.response Original Replay +2 / -2
ai.intermediate.request Original Replay +1 / -1
ai.intermediate.response Original Replay +3 / -3
ai.final.response Original Replay +3 / -3
request.response Original Replay +1 / -1
--- ALL --- Original Replay +10 / -10

Please sign in to comment.