chore: add radar-based bench suite for stdlib (#11264 )

This PR adds a new [radar]-based [temci]-less bench suite that replaces
the `stdlib` benchmarks from the old suite and also measures per-module
instruction counts. All other benchmarks from the old suite are
unaffected.

The readme at `tests/bench-radar/README.md` explains in more detail how
the bench suite is structured and how it works. The readmes in the
benchmark subdirectories explain what each benchmark does and which
metrics it collects.

All metrics except `stdlib//max dynamic symbols` were ported to the new
suite, though most have been renamed.

[radar]: https://github.com/leanprover/radar
[temci]: https://github.com/parttimenerd/temci

2025-11-25 12:59:30 +00:00

1 KiB

Raw Blame History

The `size` benchmark

This benchmark measures the number and size of a few kinds of files. It expects to be executed after the stdlib benchmark.

The following general metrics are collected:

size/libleanshared.so//bytes

The following metrics are collected for the entirety of stdlib:

size/stdlib/.c//files
size/stdlib/.c//lines
size/stdlib/.cpp//files
size/stdlib/.cpp//lines
size/stdlib/.lean//files
size/stdlib/.lean//lines
size/stdlib/.ilean//files
size/stdlib/.ilean//bytes
size/stdlib/.olean//files
size/stdlib/.olean//bytes
size/stdlib/.olean.server//files
size/stdlib/.olean.server//bytes
size/stdlib/.olean.private//files
size/stdlib/.olean.private//bytes
size/stdlib/.ir//files
size/stdlib/.ir//bytes

The following metrics are collected only for the Init library.

size/init/.olean//files
size/init/.olean//bytes
size/init/.olean.server//files
size/init/.olean.server//bytes
size/init/.olean.private//files
size/init/.olean.private//bytes

1 KiB Raw Blame History

The size benchmark

1 KiB

Raw Blame History

The `size` benchmark