lukasz-staniszewski commited on
Commit
7ff91e6
·
verified ·
1 Parent(s): c21ec75

Upload CAA steering vectors

Browse files
Files changed (5) hide show
  1. README.md +52 -0
  2. config.json +17 -0
  3. neg_vectors.pkl +3 -0
  4. pos_vectors.pkl +3 -0
  5. sv.pkl +3 -0
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: audio-interv
3
+ tags:
4
+ - ace-step
5
+ - activation-steering
6
+ - audio
7
+ - caa
8
+ - diffusion
9
+ - interpretability
10
+ - music
11
+ - rap_vocals
12
+ - steering
13
+ ---
14
+
15
+ # Steering Vectors — `rap_vocals` (ACE-Step)
16
+
17
+ Steering vectors for the **rap_vocals** concept on ACE-Step, computed via contrastive activation addition (CAA).
18
+
19
+ ## Quickstart
20
+
21
+ ```python
22
+ from src.steering import SteerableACEModel
23
+ from steering.caa import CAAController
24
+
25
+ model = SteerableACEModel(device="cuda")
26
+ ctrl = CAAController.from_pretrained("lukasz-staniszewski/ace-step-caa-rap-vocals", alpha=20)
27
+
28
+ with model.steer(ctrl):
29
+ audio = model.generate(prompt="instrumental music", seed=0)
30
+ ```
31
+
32
+ ## Generation config
33
+
34
+ ```json
35
+ {
36
+ "method": "standard_caa",
37
+ "concept": "rap_vocals",
38
+ "lyrics": "",
39
+ "num_cfg_passes": 2,
40
+ "save_all_cfg_passes": true,
41
+ "audio_duration": 30.0,
42
+ "num_inference_steps": 30,
43
+ "seed": 10,
44
+ "device": "cuda",
45
+ "save_dir": "steering_vectors/caa",
46
+ "guidance_scale_text": 0.0,
47
+ "guidance_scale_lyric": 0.0,
48
+ "guidance_scale": 5.0,
49
+ "guidance_interval": 1.0,
50
+ "guidance_interval_decay": 0.0
51
+ }
52
+ ```
config.json ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "method": "standard_caa",
3
+ "concept": "rap_vocals",
4
+ "lyrics": "",
5
+ "num_cfg_passes": 2,
6
+ "save_all_cfg_passes": true,
7
+ "audio_duration": 30.0,
8
+ "num_inference_steps": 30,
9
+ "seed": 10,
10
+ "device": "cuda",
11
+ "save_dir": "steering_vectors/caa",
12
+ "guidance_scale_text": 0.0,
13
+ "guidance_scale_lyric": 0.0,
14
+ "guidance_scale": 5.0,
15
+ "guidance_interval": 1.0,
16
+ "guidance_interval_decay": 0.0
17
+ }
neg_vectors.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f52bcaacdfb8e35343824afc165f1c42a89b02cbe431df6bd74b04418daba105
3
+ size 740442894
pos_vectors.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e109a9116cccb0456bde0165af5cb008982a68d4e2cb20b1e9cab6d852420bd0
3
+ size 740442894
sv.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00bc71a410fe227c9a7a063c438481821dfbd751f47e4daa7ce9d919ead71a77
3
+ size 14804843