Exporter Status

Following sections tries to capture what patches are put in place to export, what works and what does not with torch.export.export().

• Exported Programs with Dynamic Shapes
• Coverage of the Patches

Some PRs in transformers to keep in mind when it comes to export a model using a cache or a custom class:

• Completely rewrite the masking logic for all attentions

• Fix bugs in DynamicCache

• Fixes DynamicCache export issues due to control flow and inplace modifications

• Support tracable dynamicKVcache