A collection of 71 posts tagged with "Modern Data Lakes"
Enterprise customers use MinIO to build data lakehouses to store a wide variety of structured and unstructured data, and work with it using ML and analytics. Data flows into MinIO from across the enterprise and the S3 API allows applications, such as analytics and AI/ML to work with it. I previously blogged about building data pipelines with SAP Data
Read more
With MinIO, enterprises are not forced to make a choice. They can literally use FTP and SFTP to move that data into an S3-like data store. It is the principle of AND not OR.
Read more
MinIO
on
|
Tap into unlimited amounts of valuable enterprise data with SAP Cloud and MinIO.
Read more
Build data pipelines with S3 to MinIO and MinIO to MinIO batch replication.
Read more
Make you Kafka topics performant and efficient with Kafka Schema Registry.
Read more
MinIO
on
|
The Supermicro GrandTwin™ SuperServer is a solid, well-designed NVMe class hardware that we recommend for MinIO workloads.
Read more
Build your on-prem data lake with Apache Iceberg, Dremio and MinIO
Read more
Learn how to get started with Dremio and MinIO on Kubernetes for fast, scalable analytics.
Read more
We live in a cloud-native world where edge architecture must be consistent with cloud architecture, and where data can be retrieved with the same API call regardless of where it lives.
Read more
You must have heard of different data formats like Parquet, ORC, Avro, Arrow, Protobuf, Thrift and MessagePack. What are they and how to choose the right one?
Read more
Learn how to use DataProfiler, an OSS project, to identify sensitive information, & you can then use MinIO object storage to protect data.
Read more
Do you need to find a way to replace Hadoop in your data lake and add cloud-native capabilities?
Read more
Learn how to build a multi-cloud data lake with the Delta open storage format and MinIO object storage.
Read more
This post focuses on how Iceberg and MinIO complement each other and how various analytic frameworks (Spark, Flink, Trino, Dremio, and Snowflake) can leverage the two.
Read more
Enabling and tuning transparent data compression in MinIO.
Read more
MinIO
on
|
Learn how to build a cloud-native analytics and visualization stack backed by MinIO.
Read more
Working with a data lake of ZIP files? Learn how to download individual files from ZIP archives saved on MinIO.
Read more
Stellar performance-at-scale, flexibility and consistency make object storage the best choice for cloud-native enterprises.
Read more
Migrate data from HDFS to MinIO and enjoy the benefits of cloud-native architecture.
Read more
With today’s announcement of Starburst’s support for MinIO, it made sense to revisit the architectural trends that are becoming the standard for analytics workloads. Starburst provides a perfect example as we shall see shortly. The architecture follows the model of disaggregating storage and compute. Modern, high speed networks have obsoleted the old approaches espoused by the many defunct
Read more
