saw should be repeatable, or have a repeatable mode #2090
Labels
tooling: test infrastructure
Issues involving test infrastructure or test execution, or making SAW more testable
type: enhancement
Issues describing an improvement to an existing feature or capability
Milestone
Currently if you run saw multiple times or from different checkouts, the output varies. Ideally the results would be fully repeatable. This is desirable for testing and also for differential analysis of bugs and so forth.
Some solver-based things may not be fully repeatable without significant intervention and that may not be worthwhile (for example, exact counterexamples for verification failures) but there are at least two things that currently vary that could be nailed down quite easily:
The text was updated successfully, but these errors were encountered: