Add rope_theta to rope_scaling for transformers 5.4+ compatibility

#19

by oliverholworthy - opened Mar 30

base: refs/heads/main

←

from: refs/pr/19

Discussion Files changed

-1

oliverholworthy

NVIDIA org Mar 30

•

edited Mar 30

transformers==5.4.0 validates that rope_theta is present inside rope_scaling before the migration from the top-level field runs, causing a KeyError when loading the config without trust_remote_code=True. Adds rope_theta inside rope_scaling while keeping the top-level value for backwards compatibility with transformers v4.

Add rope_theta to rope_scaling for transformers v5.4+ compatibility5ec92445

oliverholworthy changed pull request title from Update rope params to Add rope_theta to rope_scaling for transformers 5.4+ compatibility Mar 30

oliverholworthy changed pull request status to open Mar 30

oliverholworthy changed pull request status to merged Mar 30

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment