Making the Most of Streaming with Kafka Schema Registry and MinIO
Make you Kafka topics performant and efficient with Kafka Schema Registry.
Read moreModern Data Lakes
A collection of 68 posts tagged with "Modern Data Lakes"
Supermicro GrandTwin™ SuperServers and MinIO for Dense Rack-Optimized Storage
The Supermicro GrandTwin™ SuperServer is a solid, well-designed NVMe class hardware that we recommend for MinIO workloads.
Read moreQuery Iceberg Tables on MinIO with Dremio
Build your on-prem data lake with Apache Iceberg, Dremio and MinIO
Read moreDremio and MinIO on Kubernetes for Fast Scalable Analytics
Learn how to get started with Dremio and MinIO on Kubernetes for fast, scalable analytics.
Read moreThe Paradox of the Edge as the Core
We live in a cloud-native world where edge architecture must be consistent with cloud architecture, and where data can be retrieved with the same API call regardless of where it lives.
Read moreThe Architect’s Guide to Data and File Formats
You must have heard of different data formats like Parquet, ORC, Avro, Arrow, Protobuf, Thrift and MessagePack. What are they and how to choose the right one?
Read moreArchitect’s Guide to Data Privacy Compliance Using OSS
Learn how to use DataProfiler, an OSS project, to identify sensitive information, & you can then use MinIO object storage to protect data.
Read moreBuilding Streaming Data Lakes with Hudi and MinIO
Do you need to find a way to replace Hadoop in your data lake and add cloud-native capabilities?
Read moreDelta Lake and MinIO for Multi-Cloud Data Lakes
Learn how to build a multi-cloud data lake with the Delta open storage format and MinIO object storage.
Read moreThe Definitive Guide to Lakehouse Architecture with Iceberg and MinIO
This post focuses on how Iceberg and MinIO complement each other and how various analytic frameworks (Spark, Flink, Trino, Dremio, and Snowflake) can leverage the two.
Read moreTransparent Data Compression on MinIO
Enabling and tuning transparent data compression in MinIO.
Read moreHow to Run Apache Druid and Apache Superset with MinIO
Learn how to build a cloud-native analytics and visualization stack backed by MinIO.
Read moreSmall File Archives in MinIO
Working with a data lake of ZIP files? Learn how to download individual files from ZIP archives saved on MinIO.
Read moreObject Storage is Primary Storage
Stellar performance-at-scale, flexibility and consistency make object storage the best choice for cloud-native enterprises.
Read moreData Migration from HDFS to MinIO
Migrate data from HDFS to MinIO and enjoy the benefits of cloud-native architecture.
Read moreDisaggregation, Analytical Engines and Starburst Trino
With today’s announcement of Starburst’s support for MinIO, it made sense to revisit the architectural trends that are becoming the standard for analytics workloads. Starburst provides a perfect example as we shall see shortly. The architecture follows the model of disaggregating storage and compute. Modern, high speed networks have obsoleted the old approaches espoused by the many defunct
Read moreMaster Full Text Search with MeiliSearch on MinIO
How to pair fast and efficient search with high-performance Kubernetes-native object storage.
Read moreKubernetes, Consistency and Commoditization - The Way of the Cloud
When you think about the cloud, it helps to think about the types of businesses that have been built with elastic compute, networking and storage as a foundational component and self-service/multi-tenancy as the vehicle for customer engagement. For the most part, those businesses succeeded at scaling by focusing their efforts on building their product, almost exclusively on a single
Read moreUsing MinIO for Know Your Customer Data at a Major Bank
Introduction Document management is a core requirement for all sorts of regulated institutions - finance, telecom, healthcare, government and others. These institutions need to manage and retain an ever growing number of documents and regulatory guidelines often require these documents to be stored for a very long term (7-10 years). Take for example, KYC (Know Your Customer) documents. Anyone starting
Read moreTurbocharging MinIO Data Lakes with Apache Arrow
With the introduction of Apache Arrow, language-independent columnar memory format for flat and hierarchical data, organized for efficient analytic operations, MinIO data lakes can be much more powerful. This article explains how to make use of Apache Arrow by using ArrowRDD.
Read more