MinIO Blog (Page 5)

How to Back Up with Restic and MinIO

on BC/DR 20 November 2023

Every system needs to be backed up because there are countless ways to lose local filesystem data and configurations. That loss can be devastating – potentially resulting in revenue loss, dissatisfied customers and even costly litigation. The statistics are pretty bleak – sixty percent of businesses that suffer a data loss event close within six months and ninety-three percent of companies that

MinIO and Quickwit

AJ AJ on DevOps 16 November 2023

In today’s post we’ll show you how to configure MinIO as a storage provider and metadata store for Quickwit.

KubeCon Chicago: Maturity Arrives just in time for the AI Takeoff

Jonathan Symonds Jonathan Symonds on Kubernetes 15 November 2023

Here we are with our semi-annual critique of KubeCon. We do it for Europe and we do it for North America and we don’t pull our punches. If you don’t believe us, check out our write up on Detroit. This year is very different. Chicago had some sizzle to it. There was buzz. There was unseasonably beautiful weather.

Achieving Your Data Strategy with MinIO

Matt Sarrel Matt Sarrel @msarrel

on Object Storage 14 November 2023

In the Harvard Business Review's recent How Companies Think About Data, Leandro DalleMule and Thomas H. Davenport present "a framework for building a robust data strategy that can be applied across industries and levels of data maturity." The framework draws on their experience at AIG, a global insurance company where Mr. DalleMulle is CDO, combined with

Regulatory Compliance with MinIO Object Lambdas

Brenna Buuck Brenna Buuck

on Python 10 November 2023

Empower regulatory compliance with MinIO Object Lambdas. Seamlessly customize data on-the-fly for cost-effective and efficient data pipelines. Explore the tutorial for real-life scenarios and unleash the power of MinIO's Object Lambdas.

Using LXMIN in MinIO Multi-Node cluster

AJ AJ on DevOps 9 November 2023

In this post let's take a look at how to set up multiple LXMIN servers backing up to a multi-node multi-drive MinIO cluster.

Generative AI for the Enterprise

Keith Pijanowski Keith Pijanowski on AI/ML 8 November 2023

Introduction Generative AI represents the latest technique an enterprise can employ to unlock the data trapped within its boundaries. The easiest way to conceptualize what is possible with Generative AI is to imagine a customized Large Language Model - similar to the one powering ChatGPT - running inside your firewall. Now, this custom LLM is not the same as the

Why the Modern Datalake is Being Built Privately

Brenna Buuck Brenna Buuck

on Modern Data Lakes 3 November 2023

Why the Modern Datalake is Being Built Privately

Unlock the secrets of modern datalakes migration to the private clouds. Embrace S3 compatibility, data control, and the ever-evolving landscape for cost-effective data management. Don't miss the journey to enhanced flexibility, efficiency, and the future-proofing of your data ecosystem

Deploying MinIO Tenant and Lab considerations

AJ AJ on Kubernetes 2 November 2023

Today we’ll talk how we use our local lab to test some of the key features and functionality to not only show you but also hopefully inspire you to elevate the technology and processes in your lab too that can make debugging any application a piece of cake.

Managing Objects with Tagging and Policies

Matt Sarrel Matt Sarrel @msarrel

on Best Practices 1 November 2023

Managing Objects with Tagging and Policies

Tags are a valuable way to categorize objects saved to MinIO. Each tag is a key-value pair. You can assign tags to an object when it is saved to MinIO, or you can add them to existing objects. You might think that organizing by bucket makes sense, and it does sometimes, but this only gives you the bucket and its

An Unintended Consequence of the AI/ML Revolution - Power Shifts in the Enterprise

Jonathan Symonds Jonathan Symonds on AI/ML 29 October 2023

A lot of ink has been spilled on the significance of the AI/ML technology wave (here are our posts). What doesn’t get attention, but probably should, is how AI/ML is remaking the technology power structure inside the enterprise. As companies reorganize around a data-centric orientation, they are also reorganizing who makes and executes the technology architecture. While

The Architects Guide to the Modern Data Stack

Brenna Buuck Brenna Buuck

on Architect's Guide 27 October 2023

The Architects Guide to the Modern Data Stack

This is your symphony for data excellence. Explore the components of this modern data stack, including storage, data integration, transformation, data observability, data discovery, data visualization, data analytics, and machine learning.

If You're Having a Hard Time Migrating to the Cloud, You're Doing It Wrong

Brenna Buuck Brenna Buuck

on Cloud Native 26 October 2023

If You're Having a Hard Time Migrating to the Cloud, You're Doing It Wrong

Unlock the true potential of your cloud migration journey! Learn how embracing the cloud as an operating model, rather than a location, can revolutionize your technology approach. Find out why portability, the right tools, and open standards are your keys to success.

Build a Streaming CDC Pipeline with MinIO and Redpanda into Snowflake

Brenna Buuck Brenna Buuck

on Apache Kafka 23 October 2023

Build a Streaming CDC Pipeline with MinIO and Redpanda into Snowflake

Build a streaming Change Data Capture (CDC) pipeline with Redpanda and MinIO into Snowflake. This solution simplifies data migration and analytics, with Redpanda offering scalability, MinIO as efficient storage, and Snowflake as a cloud-native analytics engine.

Confluent Platform with MinIO Tiered Object Storage Throughput Benchmark

Matt Sarrel Matt Sarrel @msarrel

on Benchmarks 23 October 2023

Confluent Platform with MinIO Tiered Object Storage Throughput Benchmark

Confluent, Intel and MinIO conducted benchmarking and certification testing for MinIO Tiered Object Storage for Kafka storage. This blog post describes the observations and results of testing MinIO object storage as a backend for the tiered storage feature of Confluent Platform 7.1.0 on servers equipped with third generation Intel Xeon Scalable processors. The scope of these tests was

Integrating MinIO with Hugging Face Datasets

Keith Pijanowski Keith Pijanowski on AI/ML 23 October 2023

Hugging Face's DatasetDict class is a part of the Datasets library and is designed to make working with datasets destined for any model found on the Hugging Face Hub efficient. As the name implies, the DatasetDict class is a dictionary of datasets. The best way to understand objects created from this class is to look at a quick

Kubernetes Sidecar with MinIO

AJ AJ on Kubernetes 20 October 2023

To perform miscellaneous tasks, instead of modifying the main application or the container it's running in, you can run it in a separate container next to the main application as a sidecar.

MinIO's OpenID Connect Integration Explained

Aditya Manthramurthy Aditya Manthramurthy on Operator's Guide 19 October 2023

MinIO provides a flexible Identity and Access Management system that can be integrated with popular external identity providers. MinIO IAM is built with AWS IAM compatibility at its core - access is controlled by policies mirroring AWS' IAM policies. While AWS supports myriad ways to control access, including ACLs, Bucket Policies, etc, in the interest of simplicity, MinIO'

Strict Consistency is a Hard Requirement for Primary Storage

Matt Sarrel Matt Sarrel @msarrel

on Object Storage 19 October 2023

Strict Consistency is a Hard Requirement for Primary Storage

Enterprises rely on data to make decisions. Effective decision-making hinges on the accuracy, timeliness, availability, and security of data. Data consistency, an important factor that cannot be ignored when purchasing storage, involves ensuring that all relevant parties can immediately access the results of a database transaction once it has been finalized, either through commitment or rollback. This guarantees that everyone

Building a Scalable, Data Sovereign National ID System

Brian Costa Brian Costa on Modern Data Lakes 19 October 2023

Some of the smartest minds in philanthropy are backing the concept of a simple yet powerful national ID system. The Bill and Melinda Gates Foundation, the Tata Trusts, the Omidyar Network and the Pratiksha Trust have all gotten involved with this movement because of its foundational capabilities for enabling a wide range of social programmes. They have put their resources

Get a Quote

Select Plan

Choose Capacity