A collection of 40 posts tagged with "AIStor"
Tl;dr: We train a small LLM to become good at reasoning with reinforcement learning (similar to the process that led to Deepseek R1) all against AIStor AIHub, an on-premises model repository. Based on the great GRPO demo by will brown. Motivation: A growing requirement for teams is the need for an organized, secure, "single source of truth"
Read more
In today’s AI-driven enterprise landscape, resource optimization has evolved from a desirable goal into an operational imperative. As organizations scale their artificial intelligence initiatives to meet rising demands for innovation, the efficient orchestration of compute resources directly shapes operational performance and model precision. The forthcoming integration of NVIDIA GPUDirect Storage (GDS) with MinIO AIStor is a co-engineered solution slated
Read more
The Arm architecture is revolutionizing the hyperscale cloud, propelled by its Total Cost of Ownership (TCO) advantages—lower power consumption and reduced cooling requirements—that enable sustainable, high-performance computing at scale. Industry leaders like AWS, Azure, and GCP are embracing Arm to drive their latest compute instances for AI training, harnessing its efficiency to meet the demands of data-intensive workloads.
Read more
Building upon AIStor's robust AI capabilities, MinIO's PromptObject has been enabling users to interact with their data through natural language queries as described here. PromptObject transforms how users interact with stored objects by allowing them to ask questions about their data's content and extract information using natural language—eliminating the need to write complex
Read more
Modern enterprises seeking to leverage AI capabilities often face a significant hurdle: the complex deployment and management of GPU infrastructure in their Kubernetes environments. MinIO's AIStor addresses this challenge head-on by integrating the NVIDIA GPU Operator, revolutionizing how organizations deploy and manage GPU resources for AI workloads. Through automated GPU setup, driver management, and resource optimization, this integration
Read more
MinLZ is a compression algorithm developed by MinIO. The main goal is to provide a format that offers the best-in-class compression while providing very fast decompression even with modest hardware.
Read more
A cybersecurity firm faced soaring cloud costs and performance bottlenecks with AWS S3 as their log data grew to a multi-exabyte scale. They adopted MinIO AIStor for high-performance, S3-compatible object storage, cutting costs and boosting efficiency.
Read more
In the rapidly-evolving world of artificial intelligence (AI) and machine learning (ML), speed and scalability are paramount. The ability to process massive amounts of data in real-time is a critical requirement for organizations looking to leverage AI/ML for competitive advantage. Whether it's training large machine learning models, running complex inference tasks, or scaling data pipelines, the performance
Read more
In this post we look at how search, and specifically OpenSearch can help us identify patterns or see trends in our ever growing data.
Read more
Lately, there has been a trend in the industry to bring data “closer” to home. The result is that organizations now want to keep their data on servers that they own, in their own datacenter or at a colocation provider.
Read more
AWS recently unveiled Amazon S3 Tables, claiming to optimize Iceberg analytics on S3. Yet, these "special buckets" mainly fix AWS's own limits—like request caps—not universal object storage issues. With AIStor, you get unmatched performance, no vendor lock-in, and no extra costs for table maintance.
Read more
AIStor's Prompt API transforms healthcare data—analyze MRI scans, uncover trends in medical records, and accelerate research with natural language prompts. From automating image analysis to streamlining patient care, it empowers better outcomes for providers, researchers, and patients
Read more
We’ll dive deep into the network configurations with which you can configure AIStor to the different replication strategies and network topologies that can be used to ensure your data is stored and accessed efficiently across multiple AIStor deployments.
Read more
Almost a year ago (actually 11 months ago), I wrote about the “Starving GPU Problem” and how the horsepower of Nvidia’s Graphic Processing Units (GPUs) could be so powerful that your network and your storage solution may not be able to keep up - preventing your expensive GPUs from being fully utilized. Well, in those short 11 months, a
Read more
Tl;dr: GET, PUT, PROMPT. It’s now possible to summarize, talk with, and ask questions about an object that is stored on MinIO with just natural language using the new PromptObject API. In this post, we explore a few use-cases of this new API along with code examples. Motivation: Object storage and the S3 API’s ubiquity can be
Read more
Today we announced the launch of AIStor, a new release which represents our singular focus on building the world’s finest object store for AI/ML workloads. The AIStor represents a year of accelerated learning from our biggest customers. MinIO is operating at a different level than the rest of the industry. We have multiple clients with more than 100
Read more
The object storage world to date has been defined by the S3 API concepts of PUT and GET. The world in which we live now, however, requires more. Given that MinIO has more S3 deployments than even Amazon, it fell to us to come up with the next great S3 API. That new API is the Prompt API and it
Read more
As the demands of AI and machine learning continue to accelerate, data center networking is evolving rapidly to keep pace. For many enterprises, 400GbE and even 800GbE are becoming standard choices, driven by the need for high-speed, low-latency data transfer for AI workloads that are both data-intensive and time-sensitive. AI models for tasks like large language processing, real-time analytics, and
Read more
One of the newest features of the AIStor is a private cloud version of the highly popular, open-source project, Hugging Face. This post details how AIStor’s AIHub effectively creates an API compatible, private cloud version of Hugging Face that is fully under the enterprise's control. Before we get started, it makes sense to introduce Hugging Face. Hugging
Read more
The MinIO Console has been an evolving product for several years now. Every time we learn, we think about how to improve this incredibly important part of our interaction framework. First came the Console, which saw massive adoption within a year of its introduction. More than 10K organizations to be more specific.Next came the enterprise Console. That moved from
Read more
