About

Welcome to my personal blog, where I share insights from my experiences in programming and AI. I’m currently building cutting-edge inference engines for large language models (LLMs) at Nvidia.

You can find more about me here .

Recent Posts

• Why Numeric Responses Alone Fall Short for Function Calling in LLMs

  Published:Jul 1, 2024 |  at 04:33 PM

  Why Numeric Responses Alone Fall Short for Function Calling in LLMs

• TensorRT LLM first impressions

  Published:Jun 6, 2024 |  at 02:22 PM

  Learnings from building a TensorRT engine for serving Llama-3 on a RTX 4090.