Output Projection missing (c_proj from Python code)

Author: bermeitinger-bCreated Mar 2, 2026Updated Mar 2, 2026

Hi. Thank you for this illustration of how GPT-2 works. Could you clarify if the output projection matrix Wo is not shown? In your Python script, it is available in each decoder block as c_proj but I believe it's missing from the visualization.

Source: poloclub/transformer-explainer