Learnable Multipliers: Circuit-Specific Impact

How per-matrix scalar multipliers differentially enhance reasoning vs knowledge circuits in transformers. Based on Velikanov et al. (2026).

1.5
0.3
100

Multiplier Deviation by Circuit Type

Benchmark Impact

Training Dynamics

Layer-wise Pattern