Earlier this month, Amazon held their re:Invent conference in Las Vegas, Nevada, from December 1st to 5th - a 5-day event. If you have never been to a re:Invent conference, then the word that describes it best is “huge” - not just in terms of the number of attendees (60,000) but also the breadth of topics covered.
Read more
2024 was a HUGE year for MinIO. Not only did we release AIStor, the most powerful version of MinIO to date, but we also attended 54 events, wrote 159 blogs, won over 10 awards and so much more. And all of it wouldn’t be possible without the support of our amazing MinIO community. So, as a shoutout to you
Read more
In November of 2023 Amazon announced the S3 Connector for PyTorch. The Amazon S3 Connector for PyTorch provides implementations of PyTorch's dataset primitives (Datasets and DataLoaders) that are purpose-built for S3 object storage. It supports map-style datasets for random data access patterns and iterable-style datasets for streaming sequential data access patterns. In a previous post, I introduced the
Read more
AWS recently unveiled Amazon S3 Tables, claiming to optimize Iceberg analytics on S3. Yet, these "special buckets" mainly fix AWS's own limits—like request caps—not universal object storage issues. With AIStor, you get unmatched performance, no vendor lock-in, and no extra costs for table maintance.
Read more
Deep dive into AIStor mindset on how we do and recommend updates and restarts with AIStor.
Read more
AIStor's Prompt API transforms healthcare data—analyze MRI scans, uncover trends in medical records, and accelerate research with natural language prompts. From automating image analysis to streamlining patient care, it empowers better outcomes for providers, researchers, and patients
Read more
We’ll dive deep into the network configurations with which you can configure AIStor to the different replication strategies and network topologies that can be used to ensure your data is stored and accessed efficiently across multiple AIStor deployments.
Read more
How does Exness handle massive data volumes and demanding AI/ML workloads? By moving to an on-prem infrastructure powered by MinIO. From scaling their data lake to managing traffic peaks of 200 Gbps, MinIO supports their AI workflows, disaster recovery, and more.
Read more
Your DevOps Engineer’s customer should be your AI/ML Engineering Team. The DevOps Engineer is there to ease the friction points in infrastructure so AI/ML folks can focus on the task at hand. Any issues that come with the infrastructure should be the responsibility of the DevOps Engineer.
Read more
Almost a year ago (actually 11 months ago), I wrote about the “Starving GPU Problem” and how the horsepower of Nvidia’s Graphic Processing Units (GPUs) could be so powerful that your network and your storage solution may not be able to keep up - preventing your expensive GPUs from being fully utilized. Well, in those short 11 months, a
Read more
In this tutorial, we’ll bake the MinIO binary and the service dependencies, such as the username and group required for MinIO. We are baking this instead of frying because these will remain the same no matter how we configure and launch our image.
Read more
A mobile application is a company's brand available on demand. It is a window into any service or product an organization offers. At Kobiton, they understand this—it is their mission to improve mobile applications through testing. Kobiton is a mobile testing platform that allows customers to perform manual and automated testing on real mobile devices from anywhere
Read more
Have you ever wondered how the big dogs with hundreds of apps and millions of users manage their Continuous Integration (Builds) and Continuous Delivery (Deployments) workflows?
Read more
An educational services leader transformed its IT with MinIO, achieving 40% faster performance and 30% lower costs. Powered by Kubernetes, MinIO supports AI, ML, and scalable data lakes with active-active replication. Discover how they modernized for innovation and resilience.
Read more
Tl;dr: GET, PUT, PROMPT. It’s now possible to summarize, talk with, and ask questions about an object that is stored on MinIO with just natural language using the new PromptObject API. In this post, we explore a few use-cases of this new API along with code examples. Motivation: Object storage and the S3 API’s ubiquity can be
Read more
Today we announced the launch of AIStor, a new release which represents our singular focus on building the world’s finest object store for AI/ML workloads. The AIStor represents a year of accelerated learning from our biggest customers. MinIO is operating at a different level than the rest of the industry. We have multiple clients with more than 100
Read more
The object storage world to date has been defined by the S3 API concepts of PUT and GET. The world in which we live now, however, requires more. Given that MinIO has more S3 deployments than even Amazon, it fell to us to come up with the next great S3 API. That new API is the Prompt API and it
Read more
As the demands of AI and machine learning continue to accelerate, data center networking is evolving rapidly to keep pace. For many enterprises, 400GbE and even 800GbE are becoming standard choices, driven by the need for high-speed, low-latency data transfer for AI workloads that are both data-intensive and time-sensitive. AI models for tasks like large language processing, real-time analytics, and
Read more
One of the newest features of the AIStor is a private cloud version of the highly popular, open-source project, Hugging Face. This post details how AIStor’s AIHub effectively creates an API compatible, private cloud version of Hugging Face that is fully under the enterprise's control. Before we get started, it makes sense to introduce Hugging Face. Hugging
Read more
The MinIO Console has been an evolving product for several years now. Every time we learn, we think about how to improve this incredibly important part of our interaction framework. First came the Console, which saw massive adoption within a year of its introduction. More than 10K organizations to be more specific.Next came the enterprise Console. That moved from
Read more
