Kubernetes Sidecar with MinIO
To perform miscellaneous tasks, instead of modifying the main application or the container it's running in, you can run it in a separate container next to the main application as a sidecar.
Read moreMinIO Blog
MinIO's OpenID Connect Integration Explained
MinIO provides a flexible Identity and Access Management system that can be integrated with popular external identity providers. MinIO IAM is built with AWS IAM compatibility at its core - access is controlled by policies mirroring AWS' IAM policies. While AWS supports myriad ways to control access, including ACLs, Bucket Policies, etc, in the interest of simplicity, MinIO'
Read moreStrict Consistency is a Hard Requirement for Primary Storage
Enterprises rely on data to make decisions. Effective decision-making hinges on the accuracy, timeliness, availability, and security of data. Data consistency, an important factor that cannot be ignored when purchasing storage, involves ensuring that all relevant parties can immediately access the results of a database transaction once it has been finalized, either through commitment or rollback. This guarantees that everyone
Read moreBuilding a Scalable, Data Sovereign National ID System
Some of the smartest minds in philanthropy are backing the concept of a simple yet powerful national ID system. The Bill and Melinda Gates Foundation, the Tata Trusts, the Omidyar Network and the Pratiksha Trust have all gotten involved with this movement because of its foundational capabilities for enabling a wide range of social programmes. They have put their resources
Read morePercona Streaming Backup
What is streaming mode? Essentially it allows you to backup with Percona xtraBackup without touching disk. When used alongside MinIO Jumbo, it is designed to upload and retrieve large objects from the MinIO cluster.
Read moreCreating an ML Scenario in SAP Data Intelligence Cloud to Read and Model Data in MinIO
Enterprise customers use MinIO to build data lakehouses to store a wide variety of structured and unstructured data, and work with it using ML and analytics. Data flows into MinIO from across the enterprise and the S3 API allows applications, such as analytics and AI/ML to work with it. I previously blogged about building data pipelines with SAP Data
Read moreMinIO as Helm Chart Repository
We’ll show you how you can use your MinIO cluster (on-prem, in the cloud, or on Kubernetes) to be used as a Helm Chart repository.
Read moreYouTube Summaries: MinIO Event Notifications
MinIO’s training team recently completed a multi-part series on MinIO event monitoring, in which Will Dinyes brings us through five in-depth videos. By the end of the video series you should be able to register an event destination, subscribe to an event notification, and deploy a custom Python-based webhook. Will kicks off the MinIO event monitoring series with an
Read moreSimplify Data Pipelines
With MinIO, enterprises are not forced to make a choice. They can literally use FTP and SFTP to move that data into an S3-like data store. It is the principle of AND not OR.
Read moreStreamlining Data Streaming: A Guide to WarpStream and MinIO
Explore the next generation of data streaming with WarpStream and MinIO! While Apache Kafka has been the standard for streaming data, it may be time to consider a simpler, more cost-effective, and cloud-native solution.
Read moreGracefully handling disk failures in MinIO
In this post we’ll primarily focus on how to manage drives that are failing. We’ll either try to bring them to a good state or show the best practices on how to replace them altogether without impacting existing operations.
Read moreSnapshot Backups for MongoDB Using MinIO
Explore how MongoDB's Ops Manager pairs with MinIO's high-performance object storage, creating a robust backup strategy for safeguarding MongoDB data. Discover the power of this combination and how it can transform your data management strategy.
Read moreData Storage Optimization Myths: Deduplication vs Compression
A lot of vendors offer compression and deduplication as a feature of their storage solutions. We critically evaluate these claims by looking at the two methods used to reduce the raw disk usage. Data Compression Compression in overall terms, gets its benefit from reducing redundancy in the data you upload. This means that repeated or otherwise predictable data can be
Read moreBuild Data Pipelines with SAP Data Intelligence Cloud, SAP HANA Cloud and MinIO
Tap into unlimited amounts of valuable enterprise data with SAP Cloud and MinIO.
Read moreFine-Tuning Large Language Models with Hugging Face and MinIO
Introduction In a previous post, I presented feature extraction, which is a technique for utilizing pre-trained Large Language Models (LLMs) to solve a custom problem without having to retrain the model. Feature extraction is one of two ways to use the knowledge a model already has for a task that is different from what the model was originally trained to
Read moreOpenSearchCon 2023 Talk
Apparently, the OpenSearch folks love MinIO as much as we love OpenSearch, the talk got accepted and we were invited to present it in Seattle. It was very cold in the Northwest but we were very excited nonetheless.
Read moreFeature Extraction with Large Language Models, Hugging Face and MinIO
Introduction In this post, I am going to present a technique that every engineer should know for utilizing open source large models. Specifically, I will show how to perform feature extraction. Feature extraction is one of two ways to use the knowledge a model already has for a task that is different from what the model was originally trained to
Read moreActive-Active Example Using an Email Provider
Email is the ultimate performance-at-scale use case as it generally only goes up in terms of data volume. Further, the more data that’s stored, the more valuable the data becomes. MinIO’s multi-site active-active replication focuses on keeping the cluster in top performance.
Read moreDuckDB and MinIO for a Modern Data Stack
Dive into the world of efficient data exploration with DuckDB and MinIO, without the burden of moving your data, and discover the limitless possibilities of this powerful combination.
Read moreNetwork Configurations to Make the Most of MinIO
We’ll go deep into the network configurations with which you can configure MinIO to the different replication strategies and network topologies that can be used to ensure your data is stored and accessed efficiently across multiple MinIO deployments.
Read more