Hybrid Cloud Object Storage
Baremetal
Erasure Code Calculator
Reference Hardware
Need for Speed 2 - The Supermicro GrandTwin™ SuperServer Benchmarks
88 GB/s writes in a 2U form factor for on-prem, colo and edge object storage.
Read more...
Erasure Coding Impact on CPU Utilization in MinIO
The answer to the burning question you always wanted to ask - how does erasure coding utilize CPU?
Read more...Supermicro GrandTwin™ SuperServers and MinIO for Dense Rack-Optimized Storage
The Supermicro GrandTwin™ SuperServer is a solid, well-designed NVMe class hardware that we recommend for MinIO workloads.
Read more...Time to First Byte and Streaming Media
Time to first byte is a key performance metric for video streaming. Learn how MinIO improves customer experience and reduces churn.
Read more...MinIO Veeam Backup and Replication v12 Throughput Benchmark
Veeam Backup & Replication 12 adds the capability to use object storage as direct targets on the performance tier. The performance tier of a Veeam backup repository is the level used for fast access to the data. Previously, object storage could only be used for the capacity tier, an additional level for storing data that needs to be accessed less frequently.
Read more...Western Digital OpenFlex Data24 Performance Testing
We recently benchmarked MinIO S3 performance on the Western Digital OpenFlex Data24 using the WARP benchmark tool. Western Digital’s OpenFlex Data24 [https://www.westerndigital.com/products/data-center-platforms/openflex-data24-nvme-of-platform] NVMe-oF Storage Platform extends the high performance of NVMe flash to shared storage. It provides low-latency sharing of NVMe SSDs over a high-performance Ethernet fabric to deliver similar performance to locally
Read more...How to Benchmark MinIO with WARP and Speedtest
MinIO is the fastest object storage available, but how do you know that underlying infrastructure is free from bottlenecks?
Read more...Updated NVMe Benchmark: 2.6Tbps+ for READS
MinIO is a strong believer in transparency and data driven discussions. It is why we publish our benchmarks and challenge the rest of the industry to do so as well. It also is why we develop tools that allow a clean, clear measurement of performance and can be easily replicated. We want people to test for themselves. Further, we do
Read more...Supermicro Cloud DC Benchmark
WARP performance testing MinIO on Supermicro Cloud DC servers with NVMe drives.
Read more...Impact of Intel vs. ARM CPU Performance for Object Storage
The recent announcement from AWS about the general availability of their new ARM-powered Graviton2 servers caused us to take another look at the performance of these ARM servers. In this blog post we describe the results which you may find surprising. Introduction MinIO [https://github.com/minio/minio] is an Apache licensed, open source S3-compatible object storage server with a
Read more...Accelerating aggregate MD5 hashing up to 800% with AVX512
Introduction While MD5 hashing is no longer a good choice when considering a hash function, it is still being used in a great variety of applications. As such any performance improvements that can be made to the MD5 hashing speed are worth considering. Due to recent improvements in SIMD processing (AVX2 and especially AVX512) we are providing a Go md5-simd
Read more...simdjson-go: Parsing gigabytes of JSON per second in Go
Introduction JSON has established itself as the "lingua franca" of the web. As such the parsing performance of JSON is hugely important for many applications. Despite the simple and human-friendly nature of JSON, it is not a technically trivial format to parse at high speeds. Recently some new designs have been presented one of which is simdjson [https://github.com/
Read more...Scaling MinIO: Benchmarking Performance From Terabytes to Petabytes
MinIO provides the best-in-class performance as we have repeatedly shown in our previous benchmarks [https://min.io/resources/#benchmarks]. In those benchmarks, we chose the highest-end hardware and measured if MinIO could squeeze out every bit of the resources afforded it. This proved two key points: 1. Ensuring that MinIO utilizes the maximum possible CPU, Network, and Storage available. 2.
Read more...Performance at Scale: MinIO Pushes Past 1.4 terabits per second with 256 NVMe Drives
The fact that MinIO is fast is not a secret. We routinely publish our benchmarks and have put out comparision work against HDFS [https://blog.min.io/hdfsbenchmark/] and AWS (Spark [https://blog.min.io/benchmarking-apache-spark-vs-aws-s3/] + Presto [https://blog.min.io/running-presto-on-minio-benchmarking-vs-aws-s3/]) in addition to our HDD [https://blog.min.io/s3-benchmark-using-hdd/] and NVMe [https://blog.min.io/s3-benchmark-minio-on-nvme/] numbers.
Read more...Hadoop HDFS's Logical Successor
The demise of Hadoop is probably overblown. It will not suddenly disappear from the enterprise landscape - there are simply too many clients, too much sunk investment for it to vanish into the night. What is not overblown is the fact that Hadoop, like countless technologies before it, is in secular, irreversible decline. There are a number of reasons but
Read more...Breaking the HDFS Speed Barrier - a First for Object Storage
Few would argue with the statement that Hadoop HDFS is in decline. In fact, the HDFS part of the Hadoop ecosystem is in more than just decline - it is in freefall. At the time of its inception, it had a meaningful role to play as a high-throughput, fault-tolerant distributed file system. The secret sauce was data locality. By co-locating
Read more...Benchmarking MinIO vs. AWS S3 for Apache Spark
Apache Spark is a framework for distributed computing. It provides one of the best mechanisms for distributing data across multiple machines in a cluster and performing computations on it. Spark achieves this by constructing data structures called RDDs (Resilient Distributed Datasets). RDDs allow data to be broken into disparate chunks and processed independently of one another. The individual chunks can
Read more...Running Apache Presto on MinIO: Benchmarking vs. AWS S3
The growth of Presto in the enterprise is a function of its speed, SQL compatibility, extensibility and enterprise feature set. While initially designed to speed up Hadoop, the success of the project has led to much broader adoption - on S3, Cassandra, MySQL, and more. Presto allows for data queries that traverse data stores and locations - a big plus
Read more...S3 Benchmark: MinIO on NVMe
Well written software is fast software. When MinIO was conceived it was designed from scratch to be simple, to scale (because simple things scale better) and to be fast. Simplicity and scale have their own subjective and objective measures - but fast is generally a numbers game. When you take well-written, fast software and pair it with fast hardware the
Read more...S3 Benchmark: MinIO on HDDs
High performance object storage is one of the hotter topics in the enterprise today. On the one hand, object storage has become an indispensable part of the enterprise storage strategy (public or private cloud) - carrying the vast, vast majority of the enterprise burden when measured in TBs or PBs. On the other hand, object storage has traditionally served a
Read more...