
hrushik reddy
ai engineer.
India-based ai engineer, currently at techolution. for the past 2+ years i've been fine-tuning open-source llms, building real-time speech pipelines, and designing the infra that keeps them alive in production. i care about systems that actually ship - demos are easy, uptime is the hard part.
about
tldr; i'm the person who takes a model from “works in a notebook” to “serves 20k+ requests a day without falling over”. at techolution i fine-tune and serve models like llama-3, deepseek and qwen-vl (~35% accuracy gains, ~40% lower latency), and build speech pipelines that go from mic to voice in under 2 seconds.
before this i shipped vision-llm content moderation at multeway and an adaptive-rag llama-2 tutor at eklavya. i mostly live in python, fastapi, pytorch, and whatever serving stack keeps p99 latency down. i also build small things after hours - terminal apps, cli helpers, on-device asr for telugu.
when i'm not shipping models i'm writing about the build, grinding leetcode, or taking something apart to see how it works. open to hard ai problems, collaborations, and conversations - i reply unreasonably fast. grab my resume or say hi at phanihrushik.10@gmail.com.
projects
- md2pdfgo20★
full-stack markdown to print-ready pdf, rendered with wkhtmltopdf inside docker.
- termodoro19★
a minimal terminal pomodoro timer in go, with raw keyboard loops and unix audio alerts.
- bettrWrite14★
a cli writing assistant that fixes typos, syntax and grammar with the openai api.
- Paper2PyTorch9★
a multi-agent compiler (google adk + gemini) that turns ml papers into runnable pytorch notebooks.
- Arxiv-researcher5★
a semantic rag tool to upload, index and chat with arxiv papers in natural language.
- FIN-AI4★
an ai assistant that pulls market metrics and writes performance summaries for stocks.
- Rocky LM3★
a lora fine-tune of gemma-2-2b that learns to talk like rocky from project hail mary.
- Whisper Mobile1★
fully offline telugu / english asr on android - whisper.cpp over jni, 30s clips in under 4s.
- offline-telugu-asr-android1★
on-device telugu speech-to-text and speaker diarization with onnx runtime, zero network.
exp.
- techolutionmay 2025 - current
ai engineer · full-time · hyderabad
- architected the backend infra for production llm services - 20k+ inference requests a day across client apps.
- fine-tuned and served llama-3, deepseek and qwen-vl: ~35% accuracy gains, ~40% lower latency via quantization.
- built real-time whisper + kokoro speech pipelines at sub-2s transcription-to-synthesis latency.
- multewayapr - nov 2024
fullstack developer · internship · hyderabad
- fine-tuned llava-1.5-7b to catch illicit marketplace listings from image + text (~90% better moderation).
- built the full fastapi backend on kubernetes with kafka notifications and pgvector retrieval, plus the react frontend.
- async face-verification with rabbitmq + celery; observability via prometheus + grafana.
- eklavya.mejan - apr 2024
ml engineer · internship · remote
- fine-tuned a llama-2 7b tutor on serverless gpus with adaptive rag over ncert textbooks.
- built a multi-agent video-generation pipeline (plan, slides, images, tts, assembly) - ~70% faster.
- distributed media ingestion with sqs + s3 - ~80% faster internal workflows.
stack
- genai & llm systems
- multi-agent (adk, langgraph), fine-tuning & lora, quantization, rag pipelines, serving optimization
- ml & deployment
- pytorch, computer vision, chromadb / faiss / pgvector, prometheus + grafana, model evaluation
- backend & apis
- python, fastapi, rest apis, spring boot, sse streaming
- cloud & distributed
- gcp, aws (s3, sqs), docker & kubernetes (helm), kafka / rabbitmq / celery, serverless gpus
- frontend
- react, next.js, angular, typescript, html / css
- speech & edge ai
- whisper (cloud to edge), kokoro tts, web audio api, whisper.cpp on arm64, android ndk / jni
credentials
be, electronics & communication engineering
certifications
- generative ai leader · google
- blockchain & applications · iit kanpur
- sql (advanced) · hackerrank
achievements
- 1st · mlh hackathon, 2023
- 2nd · engenius ideathon, 2024
- leetcode · @phanihrushik
writing
- real-time on the web: websockets, polling, and sseaug 2026
- understanding rpc and how mcp uses rpcaug 2026
- production grade rag system: dos and don'tsaug 2026
- monitoring outages: site reliability engineering in system designaug 2026
- how to approach ai system design interviews in 2026aug 2026
- no bs guide to code with ai in 2026aug 2026