Simplify Data Pipelines
With MinIO, enterprises are not forced to make a choice. They can literally use FTP and SFTP to move that data into an S3-like data store. It is the principle of AND not OR.
Read moreMinIO Blog
Streamlining Data Streaming: A Guide to WarpStream and MinIO
Explore the next generation of data streaming with WarpStream and MinIO! While Apache Kafka has been the standard for streaming data, it may be time to consider a simpler, more cost-effective, and cloud-native solution.
Read moreGracefully handling disk failures in MinIO
In this post we’ll primarily focus on how to manage drives that are failing. We’ll either try to bring them to a good state or show the best practices on how to replace them altogether without impacting existing operations.
Read moreSnapshot Backups for MongoDB Using MinIO
Explore how MongoDB's Ops Manager pairs with MinIO's high-performance object storage, creating a robust backup strategy for safeguarding MongoDB data. Discover the power of this combination and how it can transform your data management strategy.
Read moreData Storage Optimization Myths: Deduplication vs Compression
A lot of vendors offer compression and deduplication as a feature of their storage solutions. We critically evaluate these claims by looking at the two methods used to reduce the raw disk usage. Data Compression Compression in overall terms, gets its benefit from reducing redundancy in the data you upload. This means that repeated or otherwise predictable data can be
Read moreBuild Data Pipelines with SAP Data Intelligence Cloud, SAP HANA Cloud and MinIO
Tap into unlimited amounts of valuable enterprise data with SAP Cloud and MinIO.
Read moreFine-Tuning Large Language Models with Hugging Face and MinIO
Introduction In a previous post, I presented feature extraction, which is a technique for utilizing pre-trained Large Language Models (LLMs) to solve a custom problem without having to retrain the model. Feature extraction is one of two ways to use the knowledge a model already has for a task that is different from what the model was originally trained to
Read moreOpenSearchCon 2023 Talk
Apparently, the OpenSearch folks love MinIO as much as we love OpenSearch, the talk got accepted and we were invited to present it in Seattle. It was very cold in the Northwest but we were very excited nonetheless.
Read moreFeature Extraction with Large Language Models, Hugging Face and MinIO
Introduction In this post, I am going to present a technique that every engineer should know for utilizing open source large models. Specifically, I will show how to perform feature extraction. Feature extraction is one of two ways to use the knowledge a model already has for a task that is different from what the model was originally trained to
Read moreActive-Active Example Using an Email Provider
Email is the ultimate performance-at-scale use case as it generally only goes up in terms of data volume. Further, the more data that’s stored, the more valuable the data becomes. MinIO’s multi-site active-active replication focuses on keeping the cluster in top performance.
Read moreDuckDB and MinIO for a Modern Data Stack
Dive into the world of efficient data exploration with DuckDB and MinIO, without the burden of moving your data, and discover the limitless possibilities of this powerful combination.
Read moreNetwork Configurations to Make the Most of MinIO
We’ll go deep into the network configurations with which you can configure MinIO to the different replication strategies and network topologies that can be used to ensure your data is stored and accessed efficiently across multiple MinIO deployments.
Read moreObject Detection Made Simple with MinIO and YOLO
Tl;dr: In this post, we will create a custom image dataset and then train a You-Only-Look-Once (YOLO) model for the ubiquitous task of object detection. We will then implement a system using MinIO Bucket Notifications that can automatically perform inference on a new image. Introduction: Computer vision remains an extremely compelling application of artificial intelligence. Whether it’s recognizing
Read moreUsing OpenObserve with MinIO
OpenObserve is an open-source observability platform designed to streamline the monitoring of logs, metrics, and traces.
Read moreThe Disruptive Nature of Data Lakehouses
Introduction In 1997, Clayton Christensen, in his book The Innovator’s Dilemma, identified a pattern of innovation that tracked the capabilities, cost, and adoption by market segment between an incumbent and a new entrant. He labeled this pattern “Disruptive Innovation.” Not every successful product is disruptive - even if it causes well-established businesses to lose market share or even fail
Read moreUnderstanding the Attack Vector for CVE-2023-28432 and CVE-2023-28434
On September 4th, it was uncovered that an unknown threat actor had attacked publicly available MinIO object storage clusters. The attackers exploited two known security vulnerabilities in the MinIO server: CVE-2023-28432 and CVE-2023-28434 Both vulnerabilities had been reported and fixed on March 19th and 20th, and a new release, RELEASE.2023-03-20T20-16-18Z, was published on the same day. Both CVEs were
Read moreThe Flaw in the Unified Storage Narrative
It seems like more and more companies are touting themselves as one-stop shops for object, file and block storage these days - adopting the mantle of “unified” storage and offering to support a variety of storage protocols. The idea of supporting S3, NFS, SMB, HDFS, iSCSI, FCoE, NVMeoF and FCP all at once, is touted as the epitome of flexibility
Read moreMinIO Adds Manual Rebalancing
You don't have to rebalance data saved to MinIO, but you can if you want to.
Read moreBuilding a Data Lakehouse using Apache Iceberg and MinIO
Introduction In a previous post, I provided an introduction to Apache Iceberg and showed how it uses MinIO for storage. I also showed how to set up a development machine. To do this, I used Docker Compose to install an Apache Spark container as the processing engine, a REST catalog, and MinIO for storage. I concluded with a very simple
Read moreAccelerating MongoDB Backup with MinIO Jumbo
Make MongoDB backups faster - upload in parallel with MinIO Jumbo.
Read more
