Data Engineering

A collection of 2 posts tagged with "Data Engineering"

Building Real-time Data Pipelines with MinIO's AIStor

Samson Koshy Samson Koshy on Data Engineering | 23 May 2025

Built a portable Java data pipeline using MinIO's AIStor and Kafka that scales from Mac to Kubernetes. Containerized stack (Kafka, AIStor, Prometheus, Grafana) processes millions of events, preserving raw data for analysis while delivering real-time dashboard summaries.

Are We All DataOps Engineers Now? If So, How Can We Become Great at It?

Brenna Buuck

Brenna Buuck on AI/ML | 24 January 2025

Are We All DataOps Engineers Now? If So, How Can We Become Great at It?

The evolution of data roles never stops—first, we were all data scientists, then data engineers, and now, DataOps engineers. But is DataOps really new, or just a fresh take on the same mission: delivering business value through data?