lukasz-staniszewski's picture
Upload CAA steering vectors
f320676 verified
|
raw
history blame
1.31 kB
metadata
library_name: audio-interv
tags:
  - ace-step
  - activation-steering
  - audio
  - austeer
  - diffusion
  - interpretability
  - music
  - steering
  - tempo

Steering Vectors — tempo (ACE-Step)

Steering vectors for the tempo concept on ACE-Step, computed via contrastive activation addition (CAA).

Quickstart

from src.steering import SteerableACEModel
from steering.caa import CAAController

model = SteerableACEModel(device="cuda")
ctrl = CAAController.from_pretrained("lukasz-staniszewski/ace-step-austeer-tempo-all", alpha=20)

with model.steer(ctrl):
    audio = model.generate(prompt="instrumental music", seed=0)

Generation config

{
  "method": "austeer",
  "concept": "tempo",
  "lyrics": "[inst]",
  "layers": "all",
  "layers_collected": [
    "tf0",
    "tf1",
    "tf2",
    "tf3",
    "tf4",
    "tf5",
    "tf6",
    "tf7",
    "tf8",
    "tf9",
    "tf10",
    "tf11",
    "tf12",
    "tf13",
    "tf14",
    "tf15",
    "tf16",
    "tf17",
    "tf18",
    "tf19",
    "tf20",
    "tf21",
    "tf22",
    "tf23"
  ],
  "num_inference_steps": 30,
  "audio_duration": 30.0,
  "seed": 10,
  "guidance_scale": 5.0,
  "guidance_scale_text": 0.0,
  "guidance_scale_lyric": 0.0,
  "guidance_interval": 1.0,
  "guidance_interval_decay": 0.0
}