ML Systems · GPU Infra · Builder

Hi, I'm Punit.
I build things that matter.

ML systems engineer specializing in GPU-accelerated inference and distributed AI infrastructure — currently a Staff ML Engineer at Visa, and a contributor to vLLM's production stack. I like understanding systems from first principles, from transistors to transformer inference.

scroll

Open Courses

A study guide for SQL interview prep, distilled into a beautiful zero-dependency HTML page you can study anywhere.

About Punit

I'm a software engineer who started with blinking LEDs and ended up building ML infrastructure at scale. The journey from soldering 8051 microcontrollers to deploying GPU workloads on Kubernetes has been anything but linear — and that's what makes it fun.

My background spans embedded systems, Linux kernel development, real-time operating systems, and now machine learning platforms. I believe the best engineers are the ones who understand the full stack — from transistors to transformers.

Lately that's meant going deeper into LLM inference internals — KV cache, quantization, speculative decoding — and GPU communication primitives like NCCL, rather than stopping at the framework API. When I'm not writing code, I'm writing about it — these courses are my way of giving back.

🏢

Staff ML Engineer, Visa

Architecting on-premise and cloud ML training infrastructure and building agentic AI systems at scale.

vLLM Contributor

Merged a priority-routing feature into vLLM's production-stack, plus doc and benchmark contributions to vLLM itself — open-source LLM serving infrastructure.

🌍

Google Summer of Code

Contributing to RTEMS RTOS — GPIO, PWM drivers, and I2C drivers for BeagleBone Black. Student & mentor.

🔧

Systems at Heart

From Linux kernel patches to embedded NTP clients for protection relays — I love the low-level stuff.

Projects

A mix of hardware and software — from microcontroller boards to open-source operating systems.

Open Source Contributions

Live-synced from GitHub — merged pull requests to projects I don't maintain.

Let's Talk

Find me on the internet — always happy to chat about engineering, ML, or open source.