The benchmarks are run using asv which is also their only requirement.
To run the benchmarks, call asv run --python=same. You cannot use the
plain asv run command at the moment as asv cannot handle python packages
in subdirectories of a repository.