MinIO Blog

MinIO Blog

Build AWS S3 compatible cloud storage on GCP with Minio and Kubernetes

Applications today generate [https://blog.minio.io/object-storage-what-is-it-all-about-62920ca164ca#.qfa0ylbd1] more data than ever, and this upward trend is expected to keep up [https://www.emc.com/leadership/digital-universe/2014iview/executive-summary.htm] in foreseeable future. How do you handle this ever growing storage requirement of your application? A storage solution that can run where your application runs and can scale with

Read more

Publish Minio events via NATS

MinIO MinIO MinIO on Operator's Guide |

Introduction Minio [https://www.minio.io/] server supports Amazon S3 compatible bucket event notification for following targets AMQP [https://www.amqp.org/about/what], Elasticsearch [https://www.elastic.co/guide/en/elasticsearch/reference/current/getting-started.html] , Redis [http://redis.io/documentation], nats.io [http://nats.io/], PostgreSQL [https://www.postgresql.org/] and Apache Kafka [http://kafka.apache.org/]. Part 4

Read more

Publish MinIO events via Redis

MinIO MinIO MinIO on Operator's Guide |

Introduction Minio [https://www.minio.io/] server supports Amazon S3 compatible bucket event notification for following targets AMQP [https://www.amqp.org/about/what], Elasticsearch [https://www.elastic.co/guide/en/elasticsearch/reference/current/getting-started.html] , Redis [http://redis.io/documentation], nats.io [http://nats.io/], PostgreSQL [https://www.postgresql.org/] and Apache Kafka [http://kafka.apache.org/]. Part 3

Read more

Publish Minio events via Elasticsearch

MinIO MinIO MinIO on Operator's Guide |

Introduction Minio [https://www.minio.io/] server supports Amazon S3 compatible bucket event notification for following targets AMQP [https://www.amqp.org/about/what], Elasticsearch [https://www.elastic.co/guide/en/elasticsearch/reference/current/getting-started.html] , Redis [http://redis.io/documentation], nats.io [http://nats.io/], PostgreSQL [https://www.postgresql.org/] and Apache Kafka [http://kafka.apache.org/]. Part 2

Read more

Publish Minio events via RabbitMQ

MinIO MinIO MinIO on Operator's Guide |
Publish Minio events via RabbitMQ

Introduction Minio [https://www.minio.io/] server supports Amazon S3 compatible bucket event notification for following targets AMQP [https://www.amqp.org/about/what], Elasticsearch [https://www.elastic.co/guide/en/elasticsearch/reference/current/getting-started.html] , Redis [http://redis.io/documentation], nats.io [http://nats.io/], PostgreSQL [https://www.postgresql.org/] and Apache Kafka [http://kafka.apache.org/]. Part 1

Read more

s3verify — A simple tool to verify AWS S3 API compatibility

MinIO MinIO MinIO on S3 |

s3verify performs a series of API calls against an object storage server and checks the responses for AWS S3 signature version 4 compatibility. s3verify is licensed under Apache V2.0 license. Why we built s3verify Amazon Web Service’s (AWS) Simple Storage Service (S3) has emerged as the goto cloud storage, so any new competing service has a strong incentive

Read more

Mirror Mirror: File to Cloud in 25 lines

MinIO MinIO MinIO on |

If you are interested in app development for the cloud then Minio Server [https://github.com/minio/minio] is a great choice for storing your data. If you just want to back up and share some of your most important files and images to one or more cloud storage services then Minio Client (mc) is going to be right up

Read more

Doctor : An Open Source Documentation Server

MinIO MinIO MinIO on |
Doctor : An Open Source Documentation Server

Doctor uses markdown (MD) format for documentation and github for version control. Use Doctor to aggregate multiple MD files from across repositories into a single documentation site. Doctor is licensed under Apache V2.0 license. See a live demo : https://docs.minio.io [https://docs.minio.io/] docs.minio.ioWhy we built Doctor We wanted a documentation server to simply

Read more

Accelerating SHA256 by 100x in Golang on ARM

Accelerating SHA256 by 100x in Golang on ARM

The 64-bit ARMv8 core has introduced new instructions for SHA1 and SHA2 acceleration as part of the Cryptography Extensions [http://infocenter.arm.com/help/index.jsp?topic=/com.arm.doc.ddi0501f/CHDFJBCJ.html] . We at Minio [https://minio.io/] were curious as to the difference that these instructions might make, and this turns out to be one of the nicer

Read more

Using Elasticsearch snapshots with Minio repository

MinIO MinIO MinIO on |

This article shows you how to configure Elasticsearch to store snapshots and metadata in Minio [http://minio.io]. Minio is an object storage server built for cloud application developers and devops and compatible with Amazon S3 object storage. The current aws cloud plugin of Elasticsearch has been build with an older version of the Amazon SDK, causing several issues. We’

Read more

Store your Node.js application logs to Minio

Logging remains one of the major concerns among developers. Typically, various components like the web servers, databases store logs at different locations. When something goes wrong, developers need to look all around to find the relevant logs. Wouldn’t it be nice to have your application logs automatically stored at a predefined location. You can do this with Fluentd and

Read more

Fast hashing in Golang using BLAKE2

In this blog we would like to present an optimized implementation, blake2b-simd [https://github.com/minio/blake2b-simd] , in pure Go for the BLAKE2 [https://blake2.net/] hashing algorithm that takes advantage of SIMD instructions. It gives up to a 4x speed increase over the (non-assembly) Go implementation and can achieve hashing speeds close to 1 GB/sec per core on

Read more

Storage in PaaS: Minio and Deis

Storage in PaaS: Minio and Deis

Whether you notice it or not, as an end user, storage is an important component of almost all the software we use today. As a developer however, it is important is to be able retrieve stuff in an easy yet secure and fast way. As I mentioned earlier [https://blog.minio.io/object-storage-what-is-it-all-about-62920ca164ca#.wnnc8hyfs] , Object storage is a great way

Read more

Object storage in practice: Creating a reliable data store

Object storage in practice: Creating a reliable data store

In my previous post [https://blog.minio.io/object-storage-what-is-it-all-about-62920ca164ca#.bcz4d4nnd] we learnt the why and what of object storage. Specifically, we learnt why at all a new storage paradigm is required and what it does to alleviate modern unstructured data problems. We saw how object storage lets you access objects at application layer with simple API calls over HTTP(s)

Read more

Object storage: What is it all about?

Nitish Tiwari Nitish Tiwari on |
Object storage: What is it all about?

Traditionally web applications used file systems and databases to store user data in the back-end. It was simple, structured data goes to the database and anything else goes to the file system. This was easy to manage, since rarely an application generated unstructured data — most of the applications took user input in forms and saved the data to database. However,

Read more

Feb 2016 Release of Minio Client

MinIO MinIO MinIO on |

This new release adds support for Solaris/Illumos and FreeBSD 64bit Intel. Following is the non exhaustive list of changes in this release. * Parallel code for cp and mirror is deprecated and removed. All copy operations are serial now, this fixed a number of issues related to session file missing and overall code complexity. * All cli operations now standardize on

Read more

Microstorage for Microservices

MinIO MinIO MinIO on Performance |
Microstorage for Microservices

One of the fundamental requirements of microservice is that application containers become stateless. However the states still need to be stored elsewhere, as in databases, object storage, session files, cookies, cache, etc. Microstorage is emerging as a new architecture to address the storage scalability for microservices. Microstorage inherits the idea from microservices that “only small things scale”. Scale-up is not

Read more

Command-line Access to Google Cloud Storage

MinIO MinIO MinIO on Open Source |

Since our September release of MinIO Client ‘mc’ for Amazon S3 and MinIO server, we received number of requests to also support Google cloud storage, Red Hat Ceph and Open Stack Swift. Here is the Amazon S3 API compatibility matrix for various server implementations. * Amazon S3 [https://aws.amazon.com/s3/]: Amazon S3 V4 (latest) and V2 API signature. * Minio

Read more

Nov 2015 Release of MinIO Client

MinIO MinIO MinIO on Open Source |

> Download latest MinIO client ‘mc’ http://minio.io/#mc [https://minio.io/#mc] MinIO client went through several rewrites to reach this point. We fixed a number of bugs and introduced newer ones. From this release onwards, we will push smaller but frequent updates. Here are some enhancements in this release. Google Cloud Storage [https://cloud.google.com/storage/

Read more