experimental_experiment.torch_bench.dort_profile

Profile python execution for DORT

The script runs a few iterations of a dummy llama model.

python -m experimental_experiment.torch_bench.dort_profile --help

Example, run llama model with onnxrt backend on cuda.

python -m experimental_experiment.torch_bench.dort_profile --backend ort --device cuda
experimental_experiment.torch_bench.dort_profile.main()[source]

Main function for command line python -m experimental_experiment.torch_bench.dort_profile.