Scaling up MinIO Internal Connectivity

Scaling up MinIO Internal Connectivity

A MinIO cluster operates as a uniform cluster. This means that any request must be seamlessly handled by any server. As a consequence, servers need to coordinate between themselves. This has so far been handled with traditional HTTP RPC requests - and this has served us well.  Whenever server A would like to call server B an HTTP request would

Read more...

Golang Internals Part 1: Autogenerated functions (and how to get rid of them)

Maybe if you are like us at Min [https://github.com/minio/minio]IO, you have every now and then come across ‘autogenerated’ functions in your Golang call stacks and wondered what they are all about? We had a case the other day where the call stack showed something like the following: cmd.retryStorage.ListDir(0x12847c0, 0xc420402e70, 0x1, ...) minio/cmd/

Read more...

ToolsLib switches to MinIO for scale and performance

ToolsLib recently switched to a brand new dashboard [https://toolslib.net/blog/viewpost/2017/02/28/54-welcome-new-dashboard/]. However, behind the scenes, there was another switch happening. We used block based filesystem for underlying storage. However, as we grew, the filesystem was proving difficult to scale. So, we were looking to move from block based storage to an object store system,

Read more...

Debugging Go Routine leaks

Before beginning with Debugging Goroutines leaks, let me give a small introduction of some fundamentals which will give you a broader perspective of the problem. Concurrent Programming. * Concurrent programming deals with concurrent execution of a program wherein multiple sequential streams of execution run at a time resulting in faster execution of your computations. * It helps in better utilization of multicore

Read more...

Store your Node.js application logs to Minio

Logging remains one of the major concerns among developers. Typically, various components like the web servers, databases store logs at different locations. When something goes wrong, developers need to look all around to find the relevant logs. Wouldn’t it be nice to have your application logs automatically stored at a predefined location. You can do this with Fluentd and

Read more...

Developers, Developers, Developers!!

According to an IDC study conducted in 2014, there are approximately 18.5 Million software developers world wide. Though it only accounts for a tiny 0.26% of 7 billion world population, their contribution towards overall economic prosperity and progress is mind boggling. I will publish a series of blog post to understand the developer population in detail. Cartography of

Read more...