Abdalrahman WaelWriting by Abdalrahman Wael on AI systems, language models, software engineering, and research notes.https://www.abdalrahman.computer/GPT-2 --> Llama 3, One Improvement At A Timehttps://www.abdalrahman.computer/writing/2026-05-08-gpt-2-to-llama-3-one-improvement-at-a-time/https://www.abdalrahman.computer/writing/2026-05-08-gpt-2-to-llama-3-one-improvement-at-a-time/A thinking-out-loud walkthrough of moving a GPT-2-style block toward Llama 3 with RoPE, RMSNorm, and SwiGLU.Fri, 08 May 2026 00:00:00 GMT