MinIO

MinIO Blog Posts by MinIO

A collection of 90 posts from MinIO

Hadoop HDFS's Logical Successor

MinIO MinIO MinIO on Performance |
Hadoop HDFS's Logical Successor

The "big data king" that enterprises spent billions on is dying. Not from lack of trying, but because cloud-native alternatives now beat it at its own game. AIStor is faster and cheaper than HDFS. The revolution is happening in quarters, not decades.

Read more

MinIO Batch Framework Adds Support for Expiry

MinIO MinIO MinIO on New MinIO Features |
MinIO Batch Framework Adds Support for Expiry

You can now perform S3 Delete operations using the MinIO Batch Framework to remove multitudes of objects with a single API request. The MinIO Batch Framework lets you quickly and easily perform repetitive or bulk actions like Batch Replication and Batch Key-Rotate across your MinIO deployment. The MinIO Batch Framework handles all the manual work, including managing retries and reporting

Read more

Recent Launch of Amazon S3 Express One Zone Validates That Object Storage is Primary Storage for AI

MinIO MinIO MinIO on |
Recent Launch of Amazon S3 Express One Zone Validates That Object Storage is Primary Storage for AI

We have made the case for several years that in modern data stacks object storage is primary storage. This is even more true in the age of AI where enterprises focus almost exclusively on object storage. The modern data stack relies on disaggregated compute and storage alongside cloud-native microservices running in containers on Kubernetes. As more enterprises shift to this

Read more

Data Science and AI with a SQL Server 2022 Data Lakehouse

MinIO MinIO MinIO on SQL |
Data Science and AI with a SQL Server 2022 Data Lakehouse

Microsoft SQL Server 2022 is one of the most commonly implemented enterprise relational databases. Many of the world's most successful companies, regardless of vertical, have significant SQL Server deployments. Thousands of companies have relied on SQL Server for decades. Microsoft has made great strides over the past decade in embracing open-source and standards-compliant technologies. The result is that

Read more

AI/ML Reproducibility with lakeFS and MinIO

MinIO MinIO MinIO on AI/ML |
AI/ML Reproducibility with lakeFS and MinIO

This post was written in collaboration with Amit Kesarwani from lakeFS. The reality of running multiple machine learning experiments is that managing them can become unpredictable and complicated - especially in a team environment. What often happens is that during the research process, teams constantly change configuration and data between experiments. For example, try several training sets and several hyperparameter

Read more

How to Back Up with Restic and MinIO

MinIO MinIO MinIO on BC/DR |
How to Back Up with Restic and MinIO

Every system needs to be backed up because there are countless ways to lose local filesystem data and configurations. That loss can be devastating  – potentially resulting in revenue loss, dissatisfied customers and even costly litigation. The statistics are pretty bleak – sixty percent of businesses that suffer a data loss event close within six months and ninety-three percent of companies that

Read more

Achieving Your Data Strategy with MinIO

MinIO MinIO MinIO on Object Storage |
Achieving Your Data Strategy with MinIO

In the Harvard Business Review's recent How Companies Think About Data, Leandro DalleMule and Thomas H. Davenport present "a framework for building a robust data strategy that can be applied across industries and levels of data maturity." The framework draws on their experience at AIG, a global insurance company where Mr. DalleMulle is CDO, combined with

Read more

Confluent Platform with MinIO Tiered Object Storage Throughput Benchmark

MinIO MinIO MinIO on |
Confluent Platform with MinIO Tiered Object Storage Throughput Benchmark

Confluent, Intel and MinIO conducted benchmarking and certification testing for MinIO Tiered Object Storage for Kafka storage. This blog post describes the observations and results of testing MinIO object storage as a backend for the tiered storage feature of Confluent Platform 7.1.0 on servers equipped with third generation Intel Xeon Scalable processors. The scope of these tests was

Read more

Strict Consistency is a Hard Requirement for Primary Storage

MinIO MinIO MinIO on Object Storage |
Strict Consistency is a Hard Requirement for Primary Storage

Enterprises rely on data to make decisions. Effective decision-making hinges on the accuracy, timeliness, availability, and security of data. Data consistency, an important factor that cannot be ignored when purchasing storage, involves ensuring that all relevant parties can immediately access the results of a database transaction once it has been finalized, either through commitment or rollback. This guarantees that everyone

Read more

Creating an ML Scenario in SAP Data Intelligence Cloud to Read and Model Data in MinIO

MinIO MinIO MinIO on Modern Data Lakes |
Creating an ML Scenario in SAP Data Intelligence Cloud to Read and Model Data in MinIO

Enterprise customers use MinIO to build data lakehouses to store a wide variety of structured and unstructured data, and work with it using ML and analytics. Data flows into MinIO from across the enterprise and the S3 API allows applications, such as analytics and AI/ML to work with it.   I previously blogged about building data pipelines with SAP Data

Read more