Golang - MinIO Blog

Introducing KES - Key Management at Scale

Andreas Auernhammer Andreas Auernhammer on Operator's Guide 14 May 2020

KES is a stateless and distributed key-management system for high-performance applications. We built KES as the bridge between modern applications - running as containers on Kubernetes - and centralized KMS solutions. Therefore, KES has been designed to be simple, scalable and secure by default.

simdjson-go: Parsing gigabytes of JSON per second in Go

Frank Wessels Frank Wessels on Golang 10 February 2020

Introduction JSON has established itself as the "lingua franca" of the web. As such the parsing performance of JSON is hugely important for many applications. Despite the simple and human-friendly nature of JSON, it is not a technically trivial format to parse at high speeds. Recently some new designs have been presented one of which is simdjson [https:

Golang Internals Part 2: Nice benefits of named return values

Frank Wessels Frank Wessels on Golang 28 June 2017

You may know that Golang offers the ability to name return values. Thus far at MinIO [https://github.com/minio/minio] we have not been using this feature much, but that’ll change since there are some nice hidden benefits as we will explain in this blog post. If you are like us, you may have considerable amounts of code

Golang Internals Part 1: Autogenerated functions (and how to get rid of them)

Frank Wessels Frank Wessels on Golang 14 June 2017

Maybe if you are like us at Min [https://github.com/minio/minio]IO, you have every now and then come across ‘autogenerated’ functions in your Golang call stacks and wondered what they are all about? We had a case the other day where the call stack showed something like the following: cmd.retryStorage.ListDir(0x12847c0, 0xc420402e70, 0x1, ...) minio/cmd/

Debugging Go Routine leaks

MinIO MinIO

on Golang 24 February 2017

Before beginning with Debugging Goroutines leaks, let me give a small introduction of some fundamentals which will give you a broader perspective of the problem. Concurrent Programming. * Concurrent programming deals with concurrent execution of a program wherein multiple sequential streams of execution run at a time resulting in faster execution of your computations. * It helps in better utilization of multicore

Introducing Webhooks for MinIO

MinIO MinIO

on Cloud Computing 6 February 2017

MinIO provides integration with a range of backend systems which enables you to build a complete solution for your projects. The team has recently integrated a pull request from the community to add Webhook support and wanted to tell you a bit about it.

minio/dsync: a distributed locking and syncing package for Go

Frank Wessels Frank Wessels on Performance 15 September 2016

minio/dsync [https://github.com/minio/dsync] is a package for doing distributed locks over a network of nnodes. It is designed with simplicity in mind and offers limited scalability (n <= 16). Each node is connected to all other nodes and lock requests from any node will be broadcast to all connected nodes. A node will succeed in getting

Fast hashing in Golang using BLAKE2

Frank Wessels Frank Wessels on Performance 6 July 2016

In this blog we would like to present an optimized implementation, blake2b-simd [https://github.com/minio/blake2b-simd] , in pure Go for the BLAKE2 [https://blake2.net/] hashing algorithm that takes advantage of SIMD instructions. It gives up to a 4x speed increase over the (non-assembly) Go implementation and can achieve hashing speeds close to 1 GB/sec per core on