Decompose the Model: Mechanistic Interpretability in Image Models with Generalized Integrated Gradients (GIG)

This conversation summarizes a research paper introducing Generalized Integrated Gradients (GIG) for interpreting image models. GIG analyzes the entire dataset, unlike previous methods focusing on individual classes, to identify shared concepts across images.

Paper: https://arxiv.org/pdf/2409.01610