Batch vs Stream Processing: How to Choose for Your Data Pipeline
Batch vs stream processing explained: latency, windows, event time, late data, and exactly-once caveats, plus how to choose the right model for your pipeline.
WRITING / NOTES FROM THE FORGE
Articles
In-depth tech articles on system design, DSA, AI engineering, data engineering, and building software that lasts.
Data Governance Explained: Catalogs, Lineage, and Access Control
Data governance explained for engineers: ownership, data catalogs, lineage, PII classification, access control, retention, and a practical rollout plan.
Data Warehouse vs Data Lake vs Lakehouse: Which Do You Need?
Data warehouse vs data lake vs lakehouse compared: storage, schema, cost, and open table formats like Iceberg and Delta Lake, with guidance on what to pick.
Data Analyst vs Data Scientist vs Data Engineer: Roles, Skills, and Tools
Data analyst vs data scientist vs data engineer: what each role actually does, the skills and tools it needs, how they work together, and how to choose a path.
What Is Data Engineering? A Practical Beginner's Guide
What is data engineering? Learn what data engineers do, the modern data stack, core skills, a typical day, and how the role differs from data science.