My Portfolio https://portfolio-blog-starter.vercel.app This is my portfolio RSS feed Layer Normalization as a Projection: The Complete Geometric Interpretation https://portfolio-blog-starter.vercel.app/blog/layernorm An elegant geometric perspective on how layer normalization works through the lens of vector projections Sat, 17 May 2025 00:00:00 GMT Multi Head Latent Attention: The RoPE Compatibility Problem - A Mathematical Analysis https://portfolio-blog-starter.vercel.app/blog/mla The RoPE Compatibility Problem Sun, 27 Apr 2025 00:00:00 GMT Analysis of Matrix Multiplications in Transformer Architectures https://portfolio-blog-starter.vercel.app/blog/transformer_bench A detailed exploration of matrix multiplications in Transformer blocks Wed, 01 Jan 2025 00:00:00 GMT Balancing Memory & Compute: Strategies to Manage KV Cache in LLMs https://portfolio-blog-starter.vercel.app/blog/kv_cache_optimization Techniques for Reducing the Memory Footprint of KV Caches Without Sacrificing Performance Mon, 27 May 2024 00:00:00 GMT