experimental_experiment.torch_bench.bash_bench_huggingface_big

Benchmark exporters

Benchmarks many models from the HuggingFace. Available exporters:

• eager: identity

• export: torch.export.export()

• compile: torch.compile()

• custom: experimental_experiment.torch_interpreter.to_onnx()

• torch_script: torch.onnx.export()

• onnx_dynamo: torch.onnx.export() with dynamo=True

• dynamo_export: torch.onnx.dynamo_export()

python -m experimental_experiment.torch_bench.bash_bench_huggingface_big --help

python -m experimental_experiment.torch_bench.bash_bench_huggingface_big --model ""

python -m experimental_experiment.torch_bench.bash_bench_huggingface_big \
       --model codellama --exporter eager

experimental_experiment.torch_bench.bash_bench_huggingface_big.main(args=None)

Main function for command line python -m experimental_experiment.torch_bench.bash_bench_huggingface_big.