Performance - MinIO Blog (Page 4)

IoT data storage and analysis with Fluentd, MinIO and Apache Spark

Nitish Tiwari Nitish Tiwari on Performance 12 February 2018

One of the major requirements for success with IoT strategy is the ability to store and analyze device and sensor data. As IoT brings thousands of devices online everyday, the data being generated by all these devices combined is reaching staggering levels. > Storing the IoT data in a scalable yet cost effective manner, while being able to analyze it

MinIO benchmarks with COSBench

Nitish Tiwari Nitish Tiwari on Benchmarks 16 January 2018

We take a look at COSBench performance numbers with Minio server running on NVMe drives

Debugging Go Routine leaks

MinIO MinIO

on Golang 24 February 2017

Before beginning with Debugging Goroutines leaks, let me give a small introduction of some fundamentals which will give you a broader perspective of the problem. Concurrent Programming. * Concurrent programming deals with concurrent execution of a program wherein multiple sequential streams of execution run at a time resulting in faster execution of your computations. * It helps in better utilization of multicore

minio/dsync: a distributed locking and syncing package for Go

Frank Wessels Frank Wessels on Performance 15 September 2016

minio/dsync [https://github.com/minio/dsync] is a package for doing distributed locks over a network of nnodes. It is designed with simplicity in mind and offers limited scalability (n <= 16). Each node is connected to all other nodes and lock requests from any node will be broadcast to all connected nodes. A node will succeed in getting

Accelerating SHA256 by 100x in Golang on ARM

Frank Wessels Frank Wessels on Performance 26 July 2016

The 64-bit ARMv8 core has introduced new instructions for SHA1 and SHA2 acceleration as part of the Cryptography Extensions [http://infocenter.arm.com/help/index.jsp?topic=/com.arm.doc.ddi0501f/CHDFJBCJ.html] . We at Minio [https://minio.io/] were curious as to the difference that these instructions might make, and this turns out to be one of the nicer

Fast hashing in Golang using BLAKE2

Frank Wessels Frank Wessels on Performance 6 July 2016

In this blog we would like to present an optimized implementation, blake2b-simd [https://github.com/minio/blake2b-simd] , in pure Go for the BLAKE2 [https://blake2.net/] hashing algorithm that takes advantage of SIMD instructions. It gives up to a 4x speed increase over the (non-assembly) Go implementation and can achieve hashing speeds close to 1 GB/sec per core on

Object storage in practice: Creating a reliable data store

Nitish Tiwari Nitish Tiwari on Performance 10 May 2016

In my previous post [https://blog.minio.io/object-storage-what-is-it-all-about-62920ca164ca#.bcz4d4nnd] we learnt the why and what of object storage. Specifically, we learnt why at all a new storage paradigm is required and what it does to alleviate modern unstructured data problems. We saw how object storage lets you access objects at application layer with simple API calls over HTTP(s)

Microstorage for Microservices

MinIO MinIO

on Performance 12 January 2016

One of the fundamental requirements of microservice is that application containers become stateless. However the states still need to be stored elsewhere, as in databases, object storage, session files, cookies, cache, etc. Microstorage is emerging as a new architecture to address the storage scalability for microservices. Microstorage inherits the idea from microservices that “only small things scale”. Scale-up is not