Data Engineering Archives - Akhilesh Singh Shrinet

CSV vs Parquet vs Apache Arrow: A PyArrow Benchmark on 500K–1M Rows

July 28, 2026July 28, 2026 by Shrinet

CSV vs Parquet vs Apache Arrow (Feather) PyArrow benchmark in Python by Akhilesh Singh Shrinet comparing storage size, read/write performance, and analytics efficiency.

Discover how CSV, Apache Parquet, and Apache Arrow (Feather) compare in real-world Python benchmarks. Learn which file format delivers the best storage efficiency, fastest read/write performance, and why columnar formats are the preferred choice for modern data engineering and analytics workloads.

When “Just a Date Bug” Isn’t Just a Date Bug

April 7, 2026February 28, 2026 by Shrinet

Date bug in production healthcare system causing data integrity issues due to timezone mismatch and data corruption

A seemingly minor date shift bug in production revealed deeper risks in healthcare data systems. This case highlights why disciplined data engineering, deterministic validation, and audit-safe corrections are critical to maintaining data integrity and trust.