Beta release CLIP SAE code now part of Prisma Library as v2.0.0!
Pre-release
Pre-release
We now have ViT/CLIP SAE code as part of the Prisma library!
You can see a demo here: https://github.com/soniajoseph/ViT-Prisma/blob/main/demos/Train_CLIP_SAE.ipynb
All the code is in src/vit_prisma/sae
.
What's Changed
- Trainer updates for HookedViT by @PraneetNeuro in #66
- Updated usage guide by @PraneetNeuro in #67
- Conditional hooks and a couple unit tests by @themachinefan in #70
- Base setup for loading pretrained models by @PraneetNeuro in #69
- Loading attn weights fix by @themachinefan in #71
- Folding fix by @themachinefan in #73
- ViVit by @themachinefan in #76
- Hooked prisma by @soniajoseph in #77
- run tests with github actions by @themachinefan in #78
- Support loading tiny clip by @themachinefan in #85
- Vision SAEs by @themachinefan in #90
- upgrade sae-lens to v2.1.3 by @themachinefan in #93
- Support for loading huggingface VitForImageClassification by @themachinefan in #92
- Added documentation for main demo as listed in Issue #88 by @jain18ayush in #100
- Added documentation for sae-train and eval by @jain18ayush in #102
- Cleaned up configuration parsing for SAE training by @PraneetNeuro in #99
- Sae lens 2 by @soniajoseph in #107
New Contributors
- @jain18ayush made their first contribution in #100
Full Changelog: v0.1.0...v2.0.0