Aman Ranjan Verma
Senior Data Engineer · QuillBot · building data platforms
7+ years shipping production data platforms and pipelines — clear systems, measurable impact, calm ownership.
About
Who I am
Platforms, pipelines, and the quiet craft of making data usable.
I am a Senior Data Engineer at QuillBot with 7+ years building production-grade data platforms and pipelines (ex-Flipkart, ex-Sigmoid).
Gold Medalist (B.Tech), IIIT Manipur · Executive MBA, IIM Bodh Gaya ('27). I write weekly for the data engineering community and mentor when I can.
When I am not at the keyboard: traveling, trekking, cooking, or staying close to home.
- Event tracking, governance, and analytics platforms at scale
- Backend services and workflows with low-latency performance (p99 < 10 ms, 5K+ QPS)
- Promoted within a year at Flipkart for ownership on high-impact fintech work
- Consistently rated Exceeds Expectations across performance reviews
Work
Where I've built
Impact over titles — platforms that stay up and teams that ship.
- Core contributor on event tracking, governance, and platform accessibility
- Architected microservices for NoSQL CRUD with p99 < 30 ms and 4.5K+ QPS
- ~50% ownership on plagiarism-checker architecture, build, and deploy
- ETL for historical analysis, A/B testing, email marketing, reporting, and upsell
- Feature pipelines for BNPL, credit card, and EMI products at Flipkart scale
- Supported BNPL growth past 6M adopters; credit feature & scoring automation
- Partnered with DS, analysts, CIBIL, and bank partners on data deliverables
- Scalable ETL and serverless infra for containerized Python and Spark jobs
- Production ML model and feature-pipeline deployment for data science teams
- Client work across food, finance, semiconductor, and marketing (US & India)
- Publication with ~72K monthly views and a strong view-to-read engagement rate
- Growing community (~12K followers) with weekly technical writing
Projects
Open work on the desk
A few repos worth a look — tools, playgrounds, and platform experiments.
- Config Manager
Open-source config registry: Postgres-backed immutable versions, REST API, and a web UI for browse/edit and history.
- Config Manager Java SDK
Lightweight Java client generated from OpenAPI — JDK HttpClient, no extra HTTP deps.
- WebPage-Assistance
Chrome extension to summarize, translate, Q&A, and analyze any page or screenshot with GPT — Markdown output, minimal UI.
- TowardsDataEngineering
Day-to-day commands and notes data engineers actually use — community reference repo.
- PostgreSQL-Playground
Interactive web playground for real-time PostgreSQL experiments — Flask + Docker, isolated learning environment.
- ETLInPySpark
Sample project for writing production-shaped ETL pipelines in PySpark.
Skills
Tools on the blotter
Grouped by how I actually use them — not an endless keyword dump.
Languages
- Python
- SQL
- Scala
- Go
Data
- Spark
- Airflow
- dbt
- Iceberg
- Streaming
- ETL/ELT
- Data Warehousing
- NoSQL
Cloud & Infra
- AWS
- GCP
- Docker
- Kubernetes
- CI/CD
Practices
- APIs
- MLOps
- Data Governance
- Observability
Writing
Notes from the field
Weekly posts on Iceberg, platforms, and the unglamorous parts of data eng.
- Master Apache Iceberg Table Maintenance: Dealing with Rogue Partitions
Ingestion errors, hidden snapshots, and cleaning the metadata tree.
- The Hidden Cost of Deletes: Keeping Iceberg Fast After a 500-Million Row Purge
Why dropping most of your data can tank query performance — and how to fix it.
- Control Plane vs. Data Plane: Solving DataHub’s OpenSearch Bottlenecks
Diagnose AsyncRequestTimeoutException and high tail latency in DataHub.
- Locked Out of Airbyte After Helm V2 Migration? Here’s How to Recover Your Access
Recover instance-admin-password from Kubernetes secrets after Helm V2.
Contact
Say hello
Open to remote roles and thoughtful conversations about data platforms.
