MinIO Blog

Developer Friendly Kubernetes Storage

Daniel Valdivia Daniel Valdivia @dvaldivia

on Kubernetes 22 January 2020

Most developers don’t love managing infrastructure — including storage infrastructure. One of the great things about Kubernetes is the ability to simplify infrastructure management so that developers can focus on creating applications and let Kubernetes handle orchestration. Kubernetes does not natively manage storage infrastructure — but using MinIO and Kubernetes together can help provide the storage that applications need with the

Using mc to Migrate Data to/from AWS Snowball

Harshavardhana Harshavardhana on S3 15 January 2020

As data has grown, so has the challenge associated with moving it. Indeed, the bandwidth costs to migrate a PB of data out of AWS would be more than keeping it there for years. Still, customers often need to move large amounts (100s of TBs up to PBs) with some frequency. Amazon knows this and has, in their intensely customer

The Wisdom of Crowds: Distilling the Storage Newsletter 2020 Prediction Panel

Jonathan Symonds Jonathan Symonds on 14 January 2020

The hyper-connected Philipe Nicolas is the editor of the Storage Newsletter. Each year he asks the leaders in the industry to weigh in with their predictions on what will transpire in the coming year. The list of companies is long and the respondents are distinguished. So long in fact that, Phillipe has to break it into two lists (A-M, N-Z)

Relaxing the 32-Node Restriction on MinIO

Harshavardhana Harshavardhana on Modern Data Lakes 6 January 2020

MinIO previously imposed a much-discussed 32-node per cluster limit, which we lifted in December. There was no hard technical reason for the 32-node limit — you can use MinIO to create 1,000 node clusters. That reason we imposed the limit was to drive good architectural decisions. We learned, however, that some saw this as a limitation (indeed some competitors suggested

Scaling MinIO: Benchmarking Performance From Terabytes to Petabytes

Sidhartha Mani Sidhartha Mani on Benchmarks 17 December 2019

MinIO provides the best-in-class performance as we have repeatedly shown in our previous benchmarks. In those benchmarks, we chose the highest-end hardware and measured if MinIO could squeeze out every bit of the resources afforded it. This proved two key points: Ensuring that MinIO utilizes the maximum possible CPU, Network, and Storage available.Ensuring that MinIO is NOT the IO-bottleneck.

The State of Kubernetes: Five Takeaways from Kubecon

Jonathan Symonds Jonathan Symonds on 3 December 2019

This year’s Kubecon was the biggest yet on almost every vector: attendance, announcements and keynotes :). In between all of that were some stark themes on the state of the movement, the evolving vendor landscape and the challenges ahead. While there are some great summaries, we wanted to share our thoughts on what we saw and what we think the

The New Metrics of Object Storage

Anand Babu Periasamy Anand Babu Periasamy on 23 November 2019

This post originally appeared on The New Stack. As a general rule, when people think about object storage they think about one thing — the price per TB/GB. Though a legitimate cost metric, it has the effect of making object storage one-dimensional and relegates it to archival use cases. Further, it distorts the value associated with this increasingly important part

Performance at Scale: MinIO Pushes Past 1.4 terabits per second with 256 NVMe Drives

Sidhartha Mani Sidhartha Mani on Benchmarks 2 November 2019

The fact that MinIO is fast is not a secret. We routinely publish our benchmarks and have put out comparision work against HDFS and AWS (Spark + Presto) in addition to our HDD and NVMe numbers. We recently discovered the availability of large NVMe instances on AWS. Larger than we have ever seen in fact. We procured 32 units of i3en.

Frictionless Encryption

Andreas Auernhammer Andreas Auernhammer @_aead_ on 31 October 2019

If you handle data of any kind, you have to worry about data security. This is true for multinational banks; it’s also true for small and medium-size businesses. Encryption should never be your only line of defense against malicious actors, but it is one of the most basic security best practices that every organization should consider essential. However, not

Four Takeaways from Splunk .Conf19

Jonathan Symonds Jonathan Symonds on 29 October 2019

Splunk’s .Conf event is pretty remarkable. Not only is it the “geek prom” for Splunkers, it also an opportunity to take stock of where we are on the enterprise analytics journey. Here are our top four takeaways from the event and some thoughts on what the next few quarters hold. Splunk grasps the accelerating growth of data and has