Exporter Status

Following sections tries to capture what patches are put in place to export, what works and what does not with torch.export.export().

• Exported Programs with Dynamic Shapes
• Exported ONNX with Dynamic Shapes
• Coverage of the Patches

Examples checking about dynamic dimensions:

• Export with dynamic dimensions in {0,1}

• Export with dynamic dimensions in {0,1} into ONNX

• Export with dynamic dimensions in {0,1} into ONNX (custom)

Some PRs in transformers to keep in mind when it comes to export a model using a cache or a custom class:

• Completely rewrite the masking logic for all attentions

• Fix bugs in DynamicCache

• Fixes DynamicCache export issues due to control flow and inplace modifications

• Support tracable dynamicKVcache