Benchmarks - MinIO Blog (Page 2)

Breaking the HDFS Speed Barrier - a First for Object Storage

Sidhartha Mani Sidhartha Mani on Benchmarks 6 August 2019

Few would argue with the statement that Hadoop HDFS is in decline. In fact, the HDFS part of the Hadoop ecosystem is in more than just decline - it is in freefall. At the time of its inception, it had a meaningful role to play as a high-throughput, fault-tolerant distributed file system. The secret sauce was data locality. By co-locating

Benchmarking MinIO vs. AWS S3 for Apache Spark

Sidhartha Mani Sidhartha Mani on Apache Spark 15 July 2019

Apache Spark is a framework for distributed computing. It provides one of the best mechanisms for distributing data across multiple machines in a cluster and performing computations on it. Spark achieves this by constructing data structures called RDDs (Resilient Distributed Datasets). RDDs allow data to be broken into disparate chunks and processed independently of one another. The individual chunks can

Running Apache Presto on MinIO: Benchmarking vs. AWS S3

Sidhartha Mani Sidhartha Mani on Benchmarks 8 July 2019

The growth of Presto in the enterprise is a function of its speed, SQL compatibility, extensibility and enterprise feature set. While initially designed to speed up Hadoop, the success of the project has led to much broader adoption - on S3, Cassandra, MySQL, and more. Presto allows for data queries that traverse data stores and locations - a big plus

S3 Benchmark: MinIO on NVMe

Sidhartha Mani Sidhartha Mani on Benchmarks 26 June 2019

Well written software is fast software. When MinIO was conceived it was designed from scratch to be simple, to scale (because simple things scale better) and to be fast. Simplicity and scale have their own subjective and objective measures - but fast is generally a numbers game. When you take well-written, fast software and pair it with fast hardware the

S3 Benchmark: MinIO on HDDs

Sidhartha Mani Sidhartha Mani on Benchmarks 24 June 2019

High performance object storage is one of the hotter topics in the enterprise today. On the one hand, object storage has become an indispensable part of the enterprise storage strategy (public or private cloud) - carrying the vast, vast majority of the enterprise burden when measured in TBs or PBs. On the other hand, object storage has traditionally served a

MinIO benchmarks with COSBench

Nitish Tiwari Nitish Tiwari on Benchmarks 16 January 2018

We take a look at COSBench performance numbers with Minio server running on NVMe drives