Operator's Guide - MinIO Blog

AI/ML’s Sous-Chef: Why your Second Hire should be a DevOps Engineer

AJ AJ on AI/ML 4 December 2024

Your DevOps Engineer’s customer should be your AI/ML Engineering Team. The DevOps Engineer is there to ease the friction points in infrastructure so AI/ML folks can focus on the task at hand. Any issues that come with the infrastructure should be the responsibility of the DevOps Engineer.

Working with Small Objects in AI/ML workloads

AJ AJ on Operator's Guide 16 October 2024

Cloud-native AI/ML workloads push storage to the limit with many small files. AIStor combines metadata and data to optimize small file operations.

Migrating from HDFS to AIStor

AJ AJ on Modern Data Lakes 11 September 2024

Take advantage of cloud native, Kubernetes-oriented, microservices-based architectures with object storage.

Benchmarking AIStor with WARP and Perf test

AJ AJ Cesar Celis Hernandez Cesar Celis Hernandez on Operator's Guide 21 August 2024

MinIO is the fastest object storage available, but how do you know that underlying infrastructure is free from bottlenecks?

Data and Drive parity on AIStor

AJ AJ on Operator's Guide 14 August 2024

We often talk about how good, fast and reliable access to data is paramount if you want to have an upper hand in your AI/ML game. Why is this the case? This is because hardware failures happen at different levels.

Everything You Need to Know to Repatriate from AWS S3 to MinIO

Matt Sarrel Matt Sarrel @msarrel

on Operator's Guide 22 January 2024

Everything You Need to Know to Repatriate from AWS S3 to MinIO

Step by step instructions to plan for a migrate data off AWS S3 and on MinIO on-premise.

Debugging MinIO Installs

AJ AJ on DevOps 19 January 2024

In this blog post, we’ll show you how to debug a MinIO install running in Kubernetes and also some of the common issues you might encounter when doing bare metal installation and how to rectify them.

Add Pools and expand capacity

AJ AJ on DevOps 11 January 2024

Server pools help you expand the capacity of your existing MinIO cluster quickly and easily. This blog post focuses on increasing the capacity of one cluster, which is different from adding another cluster and replicating the same data across multiple clusters.

MinIO Batch Framework Adds Support for Expiry

Matt Sarrel Matt Sarrel @msarrel

on New MinIO Features 4 January 2024

MinIO Batch Framework Adds Support for Expiry

You can now perform S3 Delete operations using the MinIO Batch Framework to remove multitudes of objects with a single API request. The MinIO Batch Framework lets you quickly and easily perform repetitive or bulk actions like Batch Replication and Batch Key-Rotate across your MinIO deployment. The MinIO Batch Framework handles all the manual work, including managing retries and reporting

Event Notifications vs Object Lambda

AJ AJ on Object Lambdas 23 November 2023

As we were writing the blogs on Event Notifications and Object Lambda we came to a realization of why there are two different features doing almost the same thing? Or are they? What is the difference between the Greek Lambda and Lightning Bolt?

Deploying MinIO Tenant and Lab considerations

AJ AJ on Kubernetes 2 November 2023

Today we’ll talk how we use our local lab to test some of the key features and functionality to not only show you but also hopefully inspire you to elevate the technology and processes in your lab too that can make debugging any application a piece of cake.

MinIO's OpenID Connect Integration Explained

Aditya Manthramurthy Aditya Manthramurthy on Operator's Guide 19 October 2023

MinIO provides a flexible Identity and Access Management system that can be integrated with popular external identity providers. MinIO IAM is built with AWS IAM compatibility at its core - access is controlled by policies mirroring AWS' IAM policies. While AWS supports myriad ways to control access, including ACLs, Bucket Policies, etc, in the interest of simplicity, MinIO'

Streamlining Data Streaming: A Guide to WarpStream and MinIO

Brenna Buuck Brenna Buuck

on Operator's Guide 12 October 2023

Streamlining Data Streaming: A Guide to WarpStream and MinIO

Explore the next generation of data streaming with WarpStream and MinIO! While Apache Kafka has been the standard for streaming data, it may be time to consider a simpler, more cost-effective, and cloud-native solution.

Gracefully handling disk failures in MinIO

AJ AJ on Best Practices 10 October 2023

In this post we’ll primarily focus on how to manage drives that are failing. We’ll either try to bring them to a good state or show the best practices on how to replace them altogether without impacting existing operations.

Snapshot Backups for MongoDB Using MinIO

Brenna Buuck Brenna Buuck

on Databases 9 October 2023

Snapshot Backups for MongoDB Using MinIO

Explore how MongoDB's Ops Manager pairs with MinIO's high-performance object storage, creating a robust backup strategy for safeguarding MongoDB data. Discover the power of this combination and how it can transform your data management strategy.

Active-Active Example Using an Email Provider

AJ AJ on Architect's Guide 25 September 2023

Email is the ultimate performance-at-scale use case as it generally only goes up in terms of data volume. Further, the more data that’s stored, the more valuable the data becomes. MinIO’s multi-site active-active replication focuses on keeping the cluster in top performance.