experimental_experiment.torch_bench.bash_bench_huggingface

Benchmark exporters

Benchmarks many models from the HuggingFace. Available exporters:

• eager: identity

• export: torch.export.export()

• compile: torch.compile()

• custom: experimental_experiment.torch_interpreter.to_onnx()

• torch_script: torch.onnx.export()

• onnx_dynamo: torch.onnx.export() with dynamo=True

• dynamo_export: torch.onnx.dynamo_export()

python -m experimental_experiment.torch_bench.bash_bench_huggingface --help

python -m experimental_experiment.torch_bench.bash_bench_huggingface --model ""

python -m experimental_experiment.torch_bench.bash_bench_huggingface \
       --model 101Dummy --exporter eager

python -m experimental_experiment.torch_bench.bash_bench_huggingface \
       --model 101Dummy,101Dummy16 --verbose=1

experimental_experiment.torch_bench.bash_bench_huggingface.main(args=None)

Main function for command line python -m experimental_experiment.torch_bench.bash_bench_huggingface.