Recent Writing
Reinforcement Learning from Human Feedback
Fri Jul 10 2026
Understanding LLM.int8(): Making Large Models Fit
Fri Jun 12 2026
Understanding Flash Attention: Making Transformers Fast
Tue Jun 09 2026
Transformer Architecture: From First Principles
Mon Jun 08 2026
Understanding Self-Attention: From First Principles
Sun Jun 07 2026
Embracing the Emptiness
Wed Dec 17 2025
Why MCP (Model Context Protocol) is Here to Stay!
Fri Apr 25 2025
hi, ankit here.
Building Software and A.I Systems from 0 -> 1, move fast, and thrive in high-ownership environments where initiative matters.
Currently Founding Engineer at
DocuraHealth (YC W26).
Previously MLE at
Pibit.ai (YC W21),
and Founding Engineer at
AarogyaID.
thank you for visiting this page :) and keep visiting
Curious about how it all started? Read more about Ankit & his story, or explore Ankit's engineering work.
THE MATH THAT BENT THE TRAJECTORY OF AI
Attention(Q, K, V) = softmax(QKT/√dk)V
Lex Fridman — Go All The Way (Charles Bukowski)
0:00
Latest News
Jul 26, 2026
Update
Mutant-AI Docs Live: Behavioral Data Generation & Red Team Agents added to find vulnerabilities in AI Agents, RAGs, and LLMs (1K+ Downloads!)
Jul 22, 2026
Launched mutant-ai v0.7.3: An agentic Python package for behavioral data generation and hypothesis-driven red team attacks.
Directory
Explore
hi — about Ankit
name — what Ankit's name means
engineering — Ankit's work
writing — articles and thoughts
projects — stuff Ankit has built
moment — photo moments
wall — leave a note
people — people & stories Ankit admires
beliefs — things Ankit believes (that others might not)
must watch — videos Ankit recommends
movies — recommendations
machine — for ai agents