Output Projection missing (c_proj from Python code)
Author: bermeitinger-bCreated Mar 2, 2026Updated Mar 2, 2026
Hi.
Thank you for this illustration of how GPT-2 works. Could you clarify if the output projection matrix Wo is not shown? In your Python script, it is available in each decoder block as c_proj but I believe it's missing from the visualization.
Source: poloclub/transformer-explainer