lukasz-staniszewski commited on
Commit
e6dd0dc
·
verified ·
1 Parent(s): 924b32a

Upload CAA steering vectors

Browse files
Files changed (3) hide show
  1. README.md +53 -0
  2. austeer.pkl +3 -0
  3. config.json +18 -0
README.md ADDED
@@ -0,0 +1,53 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: audio-interv
3
+ tags:
4
+ - ace-step
5
+ - activation-steering
6
+ - audio
7
+ - austeer
8
+ - diffusion
9
+ - genre
10
+ - interpretability
11
+ - music
12
+ - steering
13
+ ---
14
+
15
+ # Steering Vectors — `genre` (ACE-Step)
16
+
17
+ Steering vectors for the **genre** concept on ACE-Step, computed via contrastive activation addition (CAA).
18
+
19
+ ## Quickstart
20
+
21
+ ```python
22
+ from src.steering import SteerableACEModel
23
+ from steering.caa import CAAController
24
+
25
+ model = SteerableACEModel(device="cuda")
26
+ ctrl = CAAController.from_pretrained("lukasz-staniszewski/ace-step-austeer-genre-tf6tf7", alpha=20)
27
+
28
+ with model.steer(ctrl):
29
+ audio = model.generate(prompt="instrumental music", seed=0)
30
+ ```
31
+
32
+ ## Generation config
33
+
34
+ ```json
35
+ {
36
+ "method": "austeer",
37
+ "concept": "genre",
38
+ "lyrics": "[inst]",
39
+ "layers": "tf6tf7",
40
+ "layers_collected": [
41
+ "tf6",
42
+ "tf7"
43
+ ],
44
+ "num_inference_steps": 30,
45
+ "audio_duration": 30.0,
46
+ "seed": 10,
47
+ "guidance_scale": 5.0,
48
+ "guidance_scale_text": 0.0,
49
+ "guidance_scale_lyric": 0.0,
50
+ "guidance_interval": 1.0,
51
+ "guidance_interval_decay": 0.0
52
+ }
53
+ ```
austeer.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b70e1b4ae98a4dfc9223c0da6addd8647a0848b7dbbb67d921df42ac2eede185
3
+ size 2462864
config.json ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "method": "austeer",
3
+ "concept": "genre",
4
+ "lyrics": "[inst]",
5
+ "layers": "tf6tf7",
6
+ "layers_collected": [
7
+ "tf6",
8
+ "tf7"
9
+ ],
10
+ "num_inference_steps": 30,
11
+ "audio_duration": 30.0,
12
+ "seed": 10,
13
+ "guidance_scale": 5.0,
14
+ "guidance_scale_text": 0.0,
15
+ "guidance_scale_lyric": 0.0,
16
+ "guidance_interval": 1.0,
17
+ "guidance_interval_decay": 0.0
18
+ }