experimental_experiment.torch_bench.dort_profile¶
Profile python execution for DORT¶
The script runs a few iterations of a dummy llama model.
python -m experimental_experiment.torch_bench.dort_profile --help
Example, run llama model with onnxrt backend on cuda.
python -m experimental_experiment.torch_bench.dort_profile --backend ort --device cuda