:orphan:

Transformers Gallery
====================

Examples about converting HuggingFace Transformers LLMs to ONNX using InputObserver.



.. raw:: html

    <div class="sphx-glr-thumbnails">

.. thumbnail-parent-div-open

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="The example exports the same model with different ways and compares the model composition (the node distribution).">

.. only:: html

  .. image:: /auto_examples_transformers/images/thumb/sphx_glr_plot_many_exporters_thumb.png
    :alt:

  :doc:`/auto_examples_transformers/plot_many_exporters`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Export Tiny-LLM with different ways</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="This example shows how to export a HuggingFace transformers LLM to ONNX using yobx.torch.input_observer.InputObserver.">

.. only:: html

  .. image:: /auto_examples_transformers/images/thumb/sphx_glr_plot_llm_to_onnx_thumb.png
    :alt:

  :doc:`/auto_examples_transformers/plot_llm_to_onnx`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Export a LLM to ONNX with InputObserver</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="yobx.torch.validate.validate_model is a convenience function that bundles the entire export-and-verify pipeline into a single call:">

.. only:: html

  .. image:: /auto_examples_transformers/images/thumb/sphx_glr_plot_validate_model_thumb.png
    :alt:

  :doc:`/auto_examples_transformers/plot_validate_model`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Validate a LLM export and inspect discrepancies</div>
    </div>


.. thumbnail-parent-div-close

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /auto_examples_transformers/plot_many_exporters
   /auto_examples_transformers/plot_llm_to_onnx
   /auto_examples_transformers/plot_validate_model


.. only:: html

  .. container:: sphx-glr-footer sphx-glr-footer-gallery

    .. container:: sphx-glr-download sphx-glr-download-python

      :download:`Download all examples in Python source code: auto_examples_transformers_python.zip </auto_examples_transformers/auto_examples_transformers_python.zip>`

    .. container:: sphx-glr-download sphx-glr-download-jupyter

      :download:`Download all examples in Jupyter notebooks: auto_examples_transformers_jupyter.zip </auto_examples_transformers/auto_examples_transformers_jupyter.zip>`


.. only:: html

 .. rst-class:: sphx-glr-signature

    `Gallery generated by Sphinx-Gallery <https://sphinx-gallery.github.io>`_