Open Source = Bombproof

Open Source = Bombproof

Software isn't usually described as bombproof. Particularly the type of software that is responsible for large analytic jobs or machine learning workloads. The words “finicky”, “complex” or in the case of good marketing “professional grade” (meaning you need years of study and multiple certifications) are more common. Bombproof software, however, is one of the many benefits associated with active open

Read more...

Scalable Genomics Data Processing Pipeline with Alluxio, Apache Mesos, and MinIO

This is a guest blog from our friends at Guardant Health [http://www.guardanthealth.com/]. Guardant Health is the world leader in comprehensive liquid biopsy. Oncologists order our blood test to help determine if their advanced cancer patients are eligible for certain drugs that target specific genomic alterations in tumour DNA. Each test produces huge amounts of genomic data that

Read more...

ToolsLib switches to MinIO for scale and performance

ToolsLib recently switched to a brand new dashboard [https://toolslib.net/blog/viewpost/2017/02/28/54-welcome-new-dashboard/]. However, behind the scenes, there was another switch happening. We used block based filesystem for underlying storage. However, as we grew, the filesystem was proving difficult to scale. So, we were looking to move from block based storage to an object store system,

Read more...

Deploy MinIO cloud storage to Mesosphere DC/OS

Container orchestration is gaining traction as the default way to deploy applications. Developers are architecting their modern applications from the ground-up to run in containers, which enables faster deployment and more resilience. Even legacy applications are adopting containers in every way they can to access these advantages. Of the many characteristics that make an application container ready, the way it

Read more...

Publish Minio events via NATS

Introduction Minio [https://www.minio.io/] server supports Amazon S3 compatible bucket event notification for following targets AMQP [https://www.amqp.org/about/what], Elasticsearch [https://www.elastic.co/guide/en/elasticsearch/reference/current/getting-started.html] , Redis [http://redis.io/documentation], nats.io [http://nats.io/], PostgreSQL [https://www.postgresql.org/] and Apache Kafka [http://kafka.apache.org/]. Part 4

Read more...

Publish MinIO events via Redis

Introduction Minio [https://www.minio.io/] server supports Amazon S3 compatible bucket event notification for following targets AMQP [https://www.amqp.org/about/what], Elasticsearch [https://www.elastic.co/guide/en/elasticsearch/reference/current/getting-started.html] , Redis [http://redis.io/documentation], nats.io [http://nats.io/], PostgreSQL [https://www.postgresql.org/] and Apache Kafka [http://kafka.apache.org/]. Part 3

Read more...

Command-line Access to Google Cloud Storage

Since our September release of MinIO Client ‘mc’ for Amazon S3 and MinIO server, we received number of requests to also support Google cloud storage, Red Hat Ceph and Open Stack Swift. Here is the Amazon S3 API compatibility matrix for various server implementations. * Amazon S3 [https://aws.amazon.com/s3/]: Amazon S3 V4 (latest) and V2 API signature. * Minio

Read more...

Nov 2015 Release of MinIO Client

> Download latest MinIO client ‘mc’ http://minio.io/#mc [https://minio.io/#mc] MinIO client went through several rewrites to reach this point. We fixed a number of bugs and introduced newer ones. From this release onwards, we will push smaller but frequent updates. Here are some enhancements in this release. Google Cloud Storage [https://cloud.google.com/storage/], OpenStack

Read more...

Developers, Developers, Developers!!

According to an IDC study conducted in 2014, there are approximately 18.5 Million software developers world wide. Though it only accounts for a tiny 0.26% of 7 billion world population, their contribution towards overall economic prosperity and progress is mind boggling. I will publish a series of blog post to understand the developer population in detail. Cartography of

Read more...