Quantized Artifacts

This folder is reserved for the optional exported Optimum Quanto qint8 LLM-component artifact.

Run:

python scripts/export_quanto_qint8_artifact.py quantized_artifacts
python scripts/test_quanto_qint8_artifact_reload.py quantized_artifacts