AwesomeInterpretability/dlm-mask-topk-sae
Updated
Sparse Autoencoders of Diffusion Language Models (Dream-7B, LLaDA-8B) and Large Language Models (Qwen-2.5-7B, LLaMA-3-8B)
Note Dream-7B (mask) Top-K SAE
Note Dream-7B (unmask) Top-K SAE
Note LLaDA-8B (mask) Top-K SAE
Note LLaDA-8B (unmask) Top-K SAE
Note Qwen-2.5-7B Top-K SAE
Note LLaMA-3-8B Top-K SAE