Earn your RAG-ing rights with MinIO
In this blog, we will demonstrate how to use MinIO to build a Retrieval Augmented Generation(RAG) based chat application using commodity hardware.
Read moreMinIO Blog
The Real Reasons Why AI is Built on Object Storage
tl;dr: In this post, we will explore four technical reasons why AI workloads rely on high performance object store. 1. No Limits on Unstructured Data In the current paradigm of machine learning, performance and ability scales with compute, which is really a proxy for dataset size and model size (Scaling Laws for Neural Language Models, Kaplan et. al.). Over
Read moreThe Architect’s Guide to the GenAI Tech Stack - Ten Tools
This post first appeared on The New Stack on June 3rd, 2024. I previously wrote about the modern data lake reference architecture, addressing the challenges in every enterprise — more data, aging Hadoop tooling (specifically HDFS) and greater demands for RESTful APIs (S3) and performance — but I want to fill in some gaps. The modern data lake, sometimes referred to as
Read moreWARP speed your AI data storage Infrastructure
Do you know the secret to some of the best AI models out there? It's the amount of data they had access to on which they could be trained on. For AI/ML models Fast accessible Data is King. Let me emphasize, it's not just Data, but fast accessible Data.
Read moreDell ECS Data Movement to MinIO
Dell ECS's “Data Movement”, also called copy-to-cloud is a feature introduced in ECS 3.8.0.1 that allows you to copy objects from Dell ECS to MinIO which is rather popular with customers and prospects who are modernizing their storage stack to support their AI data infrastructure requirements.
Read moreBoosting Snowflake with External Tables
Unlock Snowflake's potential by integrating external tables with MinIO. Seamlessly query external data without migration, boost analytics, save costs, and simplify access. This setup provides real-time insights and maximizes your infrastructure investment for both MinIO and Snowflake.
Read moreThe Economics of Public Cloud Repatriation
What has become clear over the past couple of years is that the public cloud, for all of its benefits, doesn't deliver cost savings at scale. It delivers productivity gains, to a point, but it will not reduce your costs. There is goodness in the public cloud as it offers an incredibly powerful value proposition—infrastructure available immediately,
Read moreIntegrate MinIO with Keycloak OIDC
In this blog post, we’ll show you how to set up MinIO to work with Keycloak. But broadly it should also give you an idea of how OIDC is configured with MinIO so you can use it with anything other than Keycloak, here we just use it as an example.
Read moreThe Future of Hybrid Cloud Pipelines: Integrating MinIO, Tailscale, and GitHub Actions
Streamline your data processing capabilities, ensuring high-quality data management and secure operations. This integration not only enhances workflow automation but also leverages the advanced functionalities of MinIO and Tailscale, providing a powerful solution for modern data processing needs.
Read moreLatest Enhancements to Snowflake External Tables: What You Need to Know
Snowflake's support for external tables has seen significant updates since our last blog post on how to extend your Snowflake implementation with MinIO. External tables allow users of Snowflake to treat data in object storage like MinIO as a read-only table in Snowflake without migration. Snowflake's ongoing enhancements to their external table functionality clearly demonstrate the
Read moreMinIO Audit Logs in ElasticSearch in Kubernetes
Whether you are on-prem or in the Cloud, you want to ensure in the cloud operating model processes are set up in a homogenous way. This tutorial will give you a full overview of how you can surface MinIO audit logs in ElasticSearch so they can be searchable.
Read moreIntroducing Technical Certifications at MinIO
We are excited to announce our first technical certification, the MinIO Certified Administrator - Practitioner. The MinIO certified professional program is designed to validate an individual's practical skills administrating MinIO. For the practitioner level exam, candidates will need working knowledge of all core features and capabilities including deployment, bucket creation, versioning, life cycle management, replication, encryption, and authentication,
Read moreOptimizing Resource Utilization with MinIO Catalog
Discover how MinIO Catalog optimizes resource utilization. With real-time insights from powerful GraphQL queries, MinIO Catalog helps organizations streamline storage, cut costs, and enhance data security. Learn to manage your data efficiently and make smarter decisions.
Read moreModel Training and MLOps using MLRun and MinIO
In my previous post on MLRun, we set up a development machine with all the tools needed to experiment with MLRun. Specifically, we used a docker-compose file to create containers for the MLRun UI, the MLRun API Service, Nuclio, MinIO, and a Jupyter service. Once our containers started, we ran a simple smoke test to ensure everything was working correctly.
Read moreEssentials for AI Infrastructure—the AI in Business Podcast with AB Periasamy and Matthew DeMello
MinIO’s co-founder and CEO AB Periasamy was recently featured on the AI in Business Podcast where he had a rich conversation with Matthew DeMello—Senior Editor at Emerj—about AI infrastructure and object storage for enterprises. In this blog post, we take you through an abridged version of what was discussed. Let’s get into it. AB and Matthew
Read moreA Closer Look: MinIO Firewall
MinIO Firewall is an S3-aware data firewall for modern data protection, operating at the storage layer to safeguard your data comprehensively. Designed specifically to work with applications using MinIO object store and its API endpoints.
Read moreDeploying Application Infrastructure with MinIO S3 and Tailscale VPN
Learn how MinIO S3 object storage and Tailscale VPN simplify deploying secure and scalable application infrastructure. This blog covers how their integration offers secure networking, streamlined access, and advanced features to serve hosted applications with Tailscale.
Read moreSetting Up A Development Machine with MLRun and MinIO
MLOps is to machine learning what DevOps is to traditional software development. Both are a set of practices and principles aimed at improving collaboration between engineering teams (the Dev or ML) and IT operations (Ops) teams. The goal is to streamline the development lifecycle, from planning and development to deployment and operations, using automation. One of the primary benefits of
Read moreDeploy MinIO and Trino with Kubernetes
In this tutorial, we'll deploy a cohesive system that allows distributed SQL querying across large datasets stored in Minio, with Trino leveraging metadata from Hive Metastore and table schemas from Redis.
Read moreExploring Kubernetes v1.30: Enhancements Relevant to MinIO Deployments
Explore how Kubernetes v1.30 can enhance your MinIO deployment. Kubernetes v1.30 offers enhanced security, networking improvements upcoming features in beta. Consider upgrading for optimized, secure deployments for modern data workflows.
Read more
