
Aman Ranjan Verma
Data engineer building data and AI platforms. Also written as Aman Verma.
I build data platforms. Then I write about what works.
Senior Data Engineer (SDE-III)
7+ years building PB-scale data platforms for 100M+ users. Before QuillBot I worked on payments data at Flipkart and built platforms for high-stakes clients at Sigmoid. Recently I fixed a Kafka Connect rebalance (opens in new tab) that skipped 2.5 billion messages, repaired corrupted Iceberg partitions (opens in new tab) without data loss, and downscaled a production OpenSearch cluster (opens in new tab) without losing data. I write about these every week at Towards Data Engineering and mentor engineers getting into the field.
Email address copied
Experience
- QuillBotRoles: SDE-IISDE-IIIData Platform2023 – Present
- FlipkartRoles: Data Engineer IData Engineer IIFintech & Payments Group2021 – 2023
- SigmoidRoles: Associate SDESDE-IData Engineering
- Taco Bell
- Goldman Sachs
- Pizza Hut
- Jornaya
2019 – 2021 - Towards Data Engineering on Medium (opens in new tab)Towards Data EngineeringRoles: Editor-in-ChiefPublication & community2020 – Present
Hobby Projects
- Towards Data EngineeringPublicationMedium publication and community on data engineering, cloud architecture, AI systems and MLOps. Writer guidelines and submissions.(opens in new tab)About Towards Data Engineering
- Private Markdown EditorWeb appOnline Markdown and lightweight code editor that runs in your browser. No account, tracking or ads.No account, no tracking. Just write.(opens in new tab)About Private Markdown Editor
- Bihar Police NotebookWeb appBP Diary, also called Bihar Police Notebook, is a Hindi case diary and letter writing web app. Built by Aman Ranjan Verma.Built to make daily diary entries faster on basic phones and slow networks.(opens in new tab)About Bihar Police Notebook
- WiFi HammerChrome extensionWiFi Hammer is a free Chrome extension that wakes a stuck connection when WiFi shows connected but pages will not load. Works with Airtel and Jio.I got tired of rebooting the router to fix a connection that said it was fine.(opens in new tab)About WiFi Hammer
- Dev ToolBox ProChrome extensionFormat JSON and SQL, decode Base64 and JWT, convert Unix time and diff text, locally in a Chrome side panel.Built it because I was tired of pasting JSON into random websites.(opens in new tab)About Dev ToolBox Pro
Skills
Languages
- Python
- SQL
- Scala
- Go
Data
- Spark
- Airflow
- dbt
- Iceberg
- Streaming
- ETL/ELT
- Data Warehousing
- NoSQL
Cloud & Infra
- AWS
- GCP
- Docker
- Kubernetes
- CI/CD
Practices
- APIs
- MLOps
- Data Governance
- Observability
Writing
- How a Kafka Connect Rebalance Skipped 2.5 Billion Messages and How I Fixed ItA routine rebalance, a silent offset jump, and how I got every message back.(opens in new tab)
- How I Downscaled a Production OpenSearch Cluster Without Losing DataCutting cluster cost without a single lost document or a 2am page.(opens in new tab)
- How to Add Google Analytics 4 to a Chrome Extension (Without Breaking It)(opens in new tab)
- How I Vibe Code Data Platform with Claude 5.5 Without Burning My Token Budget(opens in new tab)
- How I Fixed Corrupted Iceberg Partition Files Without Full Table Scans or Data Loss(opens in new tab)
- Master Apache Iceberg Table Maintenance: Dealing with Rogue Partitions(opens in new tab)
- The Hidden Cost of Deletes: Keeping Iceberg Fast After a 500-Million Row Purge(opens in new tab)