AIStor on RedHat OpenShift for Local development
Running AIStor on OpenShift enables enterprises to achieve cloud-native elasticity on their hardware or cloud instance of choice, balance cost, capacity and performance.
Read moreMinIO Blog
Are We All DataOps Engineers Now? If So, How Can We Become Great at It?
The evolution of data roles never stops—first, we were all data scientists, then data engineers, and now, DataOps engineers. But is DataOps really new, or just a fresh take on the same mission: delivering business value through data?
Read moreThe Definitive Guide to Lakehouse Architecture with Iceberg and AIStor
Discover the power of Apache Iceberg and AIStor in transforming data lakehouses! From multi-engine compatibility to time travel, schema evolution, and blazing-fast performance, this guide dives deep into how Iceberg unlocks the full potential of modern AI and analytics workloads.
Read moreModel Checkpointing using Amazon’s S3 Connector for PyTorch and MinIO
In November of 2023, Amazon announced the S3 Connector for PyTorch. The Amazon S3 Connector for PyTorch provides implementations of PyTorch's dataset primitives (Datasets and DataLoaders) that are purpose-built for S3 object storage. It supports map-style datasets for random data access patterns and iterable-style datasets for streaming sequential data access patterns. The S3 Connector for PyTorch also includes
Read moreAIStor on ROSA
Lately, there has been a trend in the industry to bring data “closer” to home. The result is that organizations now want to keep their data on servers that they own, in their own datacenter or at a colocation provider.
Read moreThe Innovations from AWS re:Invent
Earlier this month, Amazon held their re:Invent conference in Las Vegas, Nevada, from December 1st to 5th - a 5-day event. If you have never been to a re:Invent conference, then the word that describes it best is “huge” - not just in terms of the number of attendees (60,000) but also the breadth of topics covered.
Read moreThe Blog Year in Review: Top 10 for 2024
2024 was a HUGE year for MinIO. Not only did we release AIStor, the most powerful version of MinIO to date, but we also attended 54 events, wrote 159 blogs, won over 10 awards and so much more. And all of it wouldn’t be possible without the support of our amazing MinIO community. So, as a shoutout to you
Read moreIterable-Style Datasets using Amazon’s S3 Connector for PyTorch and MinIO
In November of 2023 Amazon announced the S3 Connector for PyTorch. The Amazon S3 Connector for PyTorch provides implementations of PyTorch's dataset primitives (Datasets and DataLoaders) that are purpose-built for S3 object storage. It supports map-style datasets for random data access patterns and iterable-style datasets for streaming sequential data access patterns. In a previous post, I introduced the
Read moreDemystifying Amazon S3 Tables: Why AIStor Makes Special Buckets Unnecessary
AWS recently unveiled Amazon S3 Tables, claiming to optimize Iceberg analytics on S3. Yet, these "special buckets" mainly fix AWS's own limits—like request caps—not universal object storage issues. With AIStor, you get unmatched performance, no vendor lock-in, and no extra costs for table maintance.
Read moreAIStor Best Practices for Updates and Restarts
Deep dive into AIStor mindset on how we do and recommend updates and restarts with AIStor.
Read moreTalk to Your Data: Transforming Healthcare with AI-Powered Object Storage
AIStor's Prompt API transforms healthcare data—analyze MRI scans, uncover trends in medical records, and accelerate research with natural language prompts. From automating image analysis to streamlining patient care, it empowers better outcomes for providers, researchers, and patients
Read moreNetwork configurations to make the most of AIStor
We’ll dive deep into the network configurations with which you can configure AIStor to the different replication strategies and network topologies that can be used to ensure your data is stored and accessed efficiently across multiple AIStor deployments.
Read moreExness: Managing petabytes of trading data with MinIO
How does Exness handle massive data volumes and demanding AI/ML workloads? By moving to an on-prem infrastructure powered by MinIO. From scaling their data lake to managing traffic peaks of 200 Gbps, MinIO supports their AI workflows, disaster recovery, and more.
Read moreAI/ML’s Sous-Chef: Why your Second Hire should be a DevOps Engineer
Your DevOps Engineer’s customer should be your AI/ML Engineering Team. The DevOps Engineer is there to ease the friction points in infrastructure so AI/ML folks can focus on the task at hand. Any issues that come with the infrastructure should be the responsibility of the DevOps Engineer.
Read moreGPU Trends and What It Means to Your AI Infrastructure
Almost a year ago (actually 11 months ago), I wrote about the “Starving GPU Problem” and how the horsepower of Nvidia’s Graphic Processing Units (GPUs) could be so powerful that your network and your storage solution may not be able to keep up - preventing your expensive GPUs from being fully utilized. Well, in those short 11 months, a
Read moreBuild a CI/CD Pipeline for your AI/ML infrastructure
In this tutorial, we’ll bake the MinIO binary and the service dependencies, such as the username and group required for MinIO. We are baking this instead of frying because these will remain the same no matter how we configure and launch our image.
Read moreRevolutionizing Mobile Testing with Big Data and AI
A mobile application is a company's brand available on demand. It is a window into any service or product an organization offers. At Kobiton, they understand this—it is their mission to improve mobile applications through testing. Kobiton is a mobile testing platform that allows customers to perform manual and automated testing on real mobile devices from anywhere
Read moreAI/ML Continuous Integration and Continuous Delivery Foundations
Have you ever wondered how the big dogs with hundreds of apps and millions of users manage their Continuous Integration (Builds) and Continuous Delivery (Deployments) workflows?
Read moreHow an Educational Services Organization Modernized Its Infrastructure with MinIO
An educational services leader transformed its IT with MinIO, achieving 40% faster performance and 30% lower costs. Powered by Kubernetes, MinIO supports AI, ML, and scalable data lakes with active-active replication. Discover how they modernized for innovation and resilience.
Read moreChat With Your Objects Using the Prompt API
Tl;dr: GET, PUT, PROMPT. It’s now possible to summarize, talk with, and ask questions about an object that is stored on MinIO with just natural language using the new PromptObject API. In this post, we explore a few use-cases of this new API along with code examples. Motivation: Object storage and the S3 API’s ubiquity can be
Read more