Matthew Kowal
AI Interpretability Researcher
Researcher at Goodfire.AI, working on mechanistic interpretability. Previously a Member of Technical Staff at FAR AI, exploring AI safety with a focus on interpretability and LLM persuasion. PhD from York University (funded by NSERC CGS-D), where I studied interpretability of multi-modal and video understanding systems under the supervision of Kosta Derpanis. Past internships at Toyota Research Institute and Ubisoft La Forge.
Research
Anatomy of Post-Training: Using Interpretability to Characterize Data and Shape the Learning Signal
We use interpretability to audit preference data at the level of concepts and shape what models learn during post-training.
Concept Influence: Leveraging Interpretability to Improve Performance and Efficiency in Training Data Attribution
We leverage interpretability methods to improve the performance and efficiency of training data attribution.
Interpreting Physics in Video World Models
We interpret how video world models learn and represent physical concepts.
Large Language Models Can Effectively Convince People to Believe Conspiracies
Across four experiments (N = 3,996), we find LLMs can increase conspiracy beliefs as easily as they can decrease them, but guardrails and corrections help.
Feature Binding with Category-Dependent MixUp for Semantic Segmentation and Adversarial Robustness
Source separation augmentation improves semantic segmentation and robustness.