Performance - MinIO Blog (Page 2)

Faster Multi-Site Replication and Resync

on Multicloud 23 November 2022

Faster Multi-Site Replication and Resync

First introduced in late 2021, multi-site Active-Active Replication [https://blog.min.io/minio-multi-site-active-active-replication/] has grown to be one of the most impactful MinIO features. MinIO has long had the ability to replicate between buckets to synchronize objects, delete operations and metadata changes, but Multi-site Active-Active Replication goes beyond bucket replication to synchronize all buckets, IAM, security tokens, service accounts and

Metrics with MinIO using OpenTelemetry, Flask, and Prometheus

AJ AJ on Observability 27 September 2022

In this post, we will learn the process of gathering metrics from a Python application integrated with OpenTelemetry, storing them in Prometheus, and visualizing the data in a Grafana dashboard. A great tutorial by AJ from MinIO.

Transparent Data Compression on MinIO

Klaus Post Klaus Post on Operator's Guide 14 July 2022

Enabling and tuning transparent data compression in MinIO.

Block is Faster than Object Storage and Other Myths

Ugur Tigli Ugur Tigli on Performance 29 April 2022

Setting the record straight on how to compare multiple storage technologies.

Building Performant Data Infrastructure with Apache Arrow and MinIO

Jonathan Symonds Jonathan Symonds on Apache Arrow 28 April 2022

There is a lot of momentum around Apache Arrow these days. A favorite of developers and data practitioners, its use in business-critical applications has grown considerably and data driven organizations like Dremio, InfluxData, Snowflake, Streamlit, and Tellius are all heavily invested. The drivers of this adoption are superior interoperability, simpler data architectures, greater speed and efficiency, more choice of tools

Multi-Cloud Monitoring and Alerting with Prometheus and Grafana

Matt Sarrel Matt Sarrel @msarrel

on Operator's Guide 3 March 2022

Multi-Cloud Monitoring and Alerting with Prometheus and Grafana

While users take it for granted that infrastructure is available, you know that metrics, monitoring and alerting are critical to operations.

Object Storage is Primary Storage

Matt Sarrel Matt Sarrel @msarrel

on Performance 24 January 2022

Stellar performance-at-scale, flexibility and consistency make object storage the best choice for cloud-native enterprises.

Updated NVMe Benchmark: 2.6Tbps+ for READS

Harshavardhana Harshavardhana on Performance 4 January 2022

MinIO is a strong believer in transparency and data driven discussions. It is why we publish our benchmarks and challenge the rest of the industry to do so as well. It also is why we develop tools that allow a clean, clear measurement of performance and can be easily replicated. We want people to test for themselves. Further, we do

MinIO Versioning, Metadata and Storage Deep Dive

Klaus Post Klaus Post on Performance 3 January 2022

Dig into MinIO internals and learn how this distributed object storage solution is optimized to handle thousands of versions of a single object.

Introducing Performance Test for MinIO

Matt Sarrel Matt Sarrel @msarrel

on Performance 18 November 2021

One-click automated performance testing for MinIO clusters.

Supermicro Cloud DC Benchmark

Eco Eco Matt Sarrel Matt Sarrel @msarrel

on Performance 15 September 2021

WARP performance testing MinIO on Supermicro Cloud DC servers with NVMe drives.

Object Storage Erasure Coding vs. Block Storage RAID

Matt Sarrel Matt Sarrel @msarrel

on Immutability 26 July 2021

Object Storage Erasure Coding vs. Block Storage RAID

Protecting blocks is not the same as protecting objects. Learn where block-level RAID falls short compared to erasure coding in distributed object storage.

No More Default Rebalancing of Object Storage!

Matt Sarrel Matt Sarrel @msarrel

on Scalability 16 July 2021

No More Default Rebalancing of Object Storage!

MinIO server pools enable rapid expansion without the downtime and risk of rebalancing.

The Trouble With Cassandra: Why It's a Poor Choice For a Metadata Database for Object Stores

Jonathan Symonds Jonathan Symonds on Architect's Guide 17 January 2021

Cassandra is a popular, tried-and-true NoSQL database that supports key-value wide-column tables. Like any powerful tool, Cassandra has its ideal use cases - in particular, Cassandra excels at supporting write-heavy workloads, while having limitations when supporting read-heavy workloads. Cassandra's eventual consistency model and lack of transactions, multi-table support like joins, subqueries can also limit its usefulness. However, using

Why Small Objects Are Such a Big Deal

Jonathan Symonds Jonathan Symonds on Performance 22 December 2020

Over the last decade or so, object storage use cases have evolved considerably as they replace traditional file and block use cases. Specifically the need to work with small data objects is becoming commonplace. Yes, there’s still plenty of large objects but small objects are becoming more prevalent than large for specific workloads and application environments. Traditional object storage

Impact of Intel vs. ARM CPU Performance for Object Storage

Frank Wessels Frank Wessels on Intel 3 June 2020

The recent announcement from AWS about the general availability of their new ARM-powered Graviton2 servers caused us to take another look at the performance of these ARM servers. In this blog post we describe the results which you may find surprising. Introduction MinIO [https://github.com/minio/minio] is an Apache licensed, open source S3-compatible object storage server with a

Accelerating aggregate MD5 hashing up to 800% with AVX512

Frank Wessels Frank Wessels on Performance 28 April 2020

Introduction While MD5 hashing is no longer a good choice when considering a hash function, it is still being used in a great variety of applications. As such any performance improvements that can be made to the MD5 hashing speed are worth considering. Due to recent improvements in SIMD processing (AVX2 and especially AVX512) we are providing a Go md5-simd

High Performance Object Storage for Veeam Backup and Recovery

Eco Eco on Operator's Guide 23 April 2020

Veeam's V10 release adds object storage support in a big way. Find out how these two software stacks play together to deliver performance oriented backup and restore.

Introducing Sidekick - A High Performance Load Balancer

Jonathan Symonds Jonathan Symonds on Sidekick 31 March 2020

Almost all of the modern cloud-native applications use HTTPs as their primary transport mechanism even within the network. Every service is a collection of HTTPs endpoints provisioned dynamically at scale. Traditional load balancers that are built for serving web applications across the Internet are at a disadvantage here since they use old school DNS round-robin techniques for load balancing and

simdjson-go: Parsing gigabytes of JSON per second in Go

Frank Wessels Frank Wessels on Golang 10 February 2020

Introduction JSON has established itself as the "lingua franca" of the web. As such the parsing performance of JSON is hugely important for many applications. Despite the simple and human-friendly nature of JSON, it is not a technically trivial format to parse at high speeds. Recently some new designs have been presented one of which is simdjson [https: