IntroductionWhile MD5 hashing is no longer a good choice when considering a hash function, it is still being used in a great variety of applications. As such any performance improvements that can be made to the MD5 hashing speed are worth considering. Due to recent improvements in SIMD processing (AVX2 and especially AVX512) we are providing a Go md5-simd package
Read more...
IntroductionJSON has established itself as the "lingua franca" of the web. As such the parsing performance of JSON is hugely important for many applications. Despite the simple and human-friendly nature of JSON, it is not a technically trivial format to parse at high speeds. Recently some new designs have been presented one of which is simdjson by Daniel Lemire and
Read more...You may know that Golang offers the ability to name return values. Thus far at MinIO we have not been using this feature much, but that’ll change since there are some nice hidden benefits as we will explain in this blog post. If you are like us, you may have considerable amounts of code as shown down below whereby
Read more...Maybe if you are like us at MinIO, you have every now and then come across ‘autogenerated’ functions in your Golang call stacks and wondered what they are all about? We had a case the other day where the call stack showed something like the following: cmd.retryStorage.ListDir(0x12847c0, 0xc420402e70, 0x1, ...) minio/cmd/retry-storage.go:183 +0x72 cmd.(*retryStorage)
Read more...ToolsLib recently switched to a brand new dashboard. However, behind the scenes, there was another switch happening. We used block based filesystem for underlying storage. However, as we grew, the filesystem was proving difficult to scale. So, we were looking to move from block based storage to an object store system, when we found MinIO. After initial analysis, MinIO looked
Read more...Before beginning with Debugging Goroutines leaks, let me give a small introduction of some fundamentals which will give you a broader perspective of the problem. Concurrent Programming. Concurrent programming deals with concurrent execution of a program wherein multiple sequential streams of execution run at a time resulting in faster execution of your computations.It helps in better utilization of multicore
Read more...MinIO provides integration with a range of backend systems which enables you to build a complete solution for your projects. The team has recently integrated a pull request from the community to add Webhook support and wanted to tell you a bit about it.
Read more...Logging remains one of the major concerns among developers. Typically, various components like the web servers, databases store logs at different locations. When something goes wrong, developers need to look all around to find the relevant logs. Wouldn’t it be nice to have your application logs automatically stored at a predefined location. You can do this with Fluentd and
Read more...
on
Open Source
According to an IDC study conducted in 2014, there are approximately 18.5 Million software developers world wide. Though it only accounts for a tiny 0.26% of 7 billion world population, their contribution towards overall economic prosperity and progress is mind boggling. I will publish a series of blog post to understand the developer population in detail. Cartography of
Read more...
Hybrid Cloud Object Storage
Baremetal
Erasure Code Calculator
Reference Hardware