The tests need to run with certain environment variables set that only cmake really knows and that differ between stages. Cmake could just set the variables directly when running the tests and benchmarks, but that would leave no good way to manually run a single benchmark. So cmake generates some stage-specific scripts instead that set the required environment variables. Previously, those scripts were sourced directly by the individual `run_*` scripts, so the env scripts of different stages would overwrite each other. This PR changes the setup so they can instead be generated next to each other. This also simplifies the `run_*` scripts themselves a bit, and makes `tests/bench/build` less of a hack. |
||
|---|---|---|
| .. | ||
| cases | ||
| lib | ||
| baseline_add_sub_cancel.lean | ||
| lakefile.lean | ||
| lean-toolchain | ||
| README.md | ||
| run_bench.sh | ||
| run_test.sh | ||
| test_vcgen.lean | ||
| vcgen_add_sub_cancel.lean | ||
| vcgen_add_sub_cancel_deep.lean | ||
| vcgen_add_sub_cancel_simp.lean | ||
| vcgen_get_throw_set.lean | ||
| vcgen_match_split.lean | ||
| vcgen_pure_precond.lean | ||
| vcgen_reader_state.lean | ||
Benchmarks for a Sym-based mvcgen
Compares the performance of a Sym-based rewrite of mvcgen with that of a direct, hard-coded solution procedure (the shallow_add_sub_cancel benchmark).
To run the benchmarks, launch lake build.
To run individual benchmarks, run lake lean vcgen_add_sub_cancel.lean (which runs the VCGen-based version) or lake lean baseline_add_sub_cancel.lean (which runs the baseline hard-coded solution procedure).