Enterprise-Grade Cloud Storage with NGINX Plus and MinIO
In this post, I explain how to use NGINX and NGINX Plus as a reverse proxy and load balancer for MinIO servers.
Read moreMinIO Blog
Build AWS S3 compatible cloud storage on GCP with Minio and Kubernetes
Applications today generate [https://blog.minio.io/object-storage-what-is-it-all-about-62920ca164ca#.qfa0ylbd1] more data than ever, and this upward trend is expected to keep up [https://www.emc.com/leadership/digital-universe/2014iview/executive-summary.htm] in foreseeable future. How do you handle this ever growing storage requirement of your application? A storage solution that can run where your application runs and can scale with
Read morePublish Minio events via NATS
Introduction Minio [https://www.minio.io/] server supports Amazon S3 compatible bucket event notification for following targets AMQP [https://www.amqp.org/about/what], Elasticsearch [https://www.elastic.co/guide/en/elasticsearch/reference/current/getting-started.html] , Redis [http://redis.io/documentation], nats.io [http://nats.io/], PostgreSQL [https://www.postgresql.org/] and Apache Kafka [http://kafka.apache.org/]. Part 4
Read morePublish MinIO events via Redis
Introduction Minio [https://www.minio.io/] server supports Amazon S3 compatible bucket event notification for following targets AMQP [https://www.amqp.org/about/what], Elasticsearch [https://www.elastic.co/guide/en/elasticsearch/reference/current/getting-started.html] , Redis [http://redis.io/documentation], nats.io [http://nats.io/], PostgreSQL [https://www.postgresql.org/] and Apache Kafka [http://kafka.apache.org/]. Part 3
Read morePublish Minio events via Elasticsearch
Introduction Minio [https://www.minio.io/] server supports Amazon S3 compatible bucket event notification for following targets AMQP [https://www.amqp.org/about/what], Elasticsearch [https://www.elastic.co/guide/en/elasticsearch/reference/current/getting-started.html] , Redis [http://redis.io/documentation], nats.io [http://nats.io/], PostgreSQL [https://www.postgresql.org/] and Apache Kafka [http://kafka.apache.org/]. Part 2
Read moreminio/dsync: a distributed locking and syncing package for Go
minio/dsync is a package for doing distributed locks over a network of nnodes. It is designed with simplicity in mind and offers limited scalability (n <= 16). Each node is connected to all other nodes and lock requests from any node will be broadcast to all connected nodes. A node will succeed in getting the lock if n/2
Read morePublish Minio events via RabbitMQ
Introduction Minio [https://www.minio.io/] server supports Amazon S3 compatible bucket event notification for following targets AMQP [https://www.amqp.org/about/what], Elasticsearch [https://www.elastic.co/guide/en/elasticsearch/reference/current/getting-started.html] , Redis [http://redis.io/documentation], nats.io [http://nats.io/], PostgreSQL [https://www.postgresql.org/] and Apache Kafka [http://kafka.apache.org/]. Part 1
Read mores3verify — A simple tool to verify AWS S3 API compatibility
s3verify performs a series of API calls against an object storage server and checks the responses for AWS S3 signature version 4 compatibility. s3verify is licensed under Apache V2.0 license. Why we built s3verify Amazon Web Service’s (AWS) Simple Storage Service (S3) has emerged as the goto cloud storage, so any new competing service has a strong incentive
Read moreMirror Mirror: File to Cloud in 25 lines
MinIO
MinIO
on
|
MinIO
on
|
If you are interested in app development for the cloud then Minio Server [https://github.com/minio/minio] is a great choice for storing your data. If you just want to back up and share some of your most important files and images to one or more cloud storage services then Minio Client (mc) is going to be right up
Read moreDoctor : An Open Source Documentation Server
MinIO
MinIO
on
|
MinIO
on
|
Doctor uses markdown (MD) format for documentation and github for version control. Use Doctor to aggregate multiple MD files from across repositories into a single documentation site. Doctor is licensed under Apache V2.0 license. See a live demo : https://docs.minio.io [https://docs.minio.io/] docs.minio.ioWhy we built Doctor We wanted a documentation server to simply
Read moreAccelerating SHA256 by 100x in Golang on ARM
The 64-bit ARMv8 core has introduced new instructions for SHA1 and SHA2 acceleration as part of the Cryptography Extensions [http://infocenter.arm.com/help/index.jsp?topic=/com.arm.doc.ddi0501f/CHDFJBCJ.html] . We at Minio [https://minio.io/] were curious as to the difference that these instructions might make, and this turns out to be one of the nicer
Read moreUsing Elasticsearch snapshots with Minio repository
MinIO
MinIO
on
|
MinIO
on
|
This article shows you how to configure Elasticsearch to store snapshots and metadata in Minio [http://minio.io]. Minio is an object storage server built for cloud application developers and devops and compatible with Amazon S3 object storage. The current aws cloud plugin of Elasticsearch has been build with an older version of the Amazon SDK, causing several issues. We’
Read moreStore your Node.js application logs to Minio
Logging remains one of the major concerns among developers. Typically, various components like the web servers, databases store logs at different locations. When something goes wrong, developers need to look all around to find the relevant logs. Wouldn’t it be nice to have your application logs automatically stored at a predefined location. You can do this with Fluentd and
Read moreFast hashing in Golang using BLAKE2
In this blog we would like to present an optimized implementation, blake2b-simd [https://github.com/minio/blake2b-simd] , in pure Go for the BLAKE2 [https://blake2.net/] hashing algorithm that takes advantage of SIMD instructions. It gives up to a 4x speed increase over the (non-assembly) Go implementation and can achieve hashing speeds close to 1 GB/sec per core on
Read moreStorage in PaaS: Minio and Deis
Whether you notice it or not, as an end user, storage is an important component of almost all the software we use today. As a developer however, it is important is to be able retrieve stuff in an easy yet secure and fast way. As I mentioned earlier [https://blog.minio.io/object-storage-what-is-it-all-about-62920ca164ca#.wnnc8hyfs] , Object storage is a great way
Read moreObject storage in practice: Creating a reliable data store
In my previous post [https://blog.minio.io/object-storage-what-is-it-all-about-62920ca164ca#.bcz4d4nnd] we learnt the why and what of object storage. Specifically, we learnt why at all a new storage paradigm is required and what it does to alleviate modern unstructured data problems. We saw how object storage lets you access objects at application layer with simple API calls over HTTP(s)
Read moreObject storage: What is it all about?
Traditionally web applications used file systems and databases to store user data in the back-end. It was simple, structured data goes to the database and anything else goes to the file system. This was easy to manage, since rarely an application generated unstructured data — most of the applications took user input in forms and saved the data to database. However,
Read moreFeb 2016 Release of Minio Client
MinIO
MinIO
on
|
MinIO
on
|
This new release adds support for Solaris/Illumos and FreeBSD 64bit Intel. Following is the non exhaustive list of changes in this release. * Parallel code for cp and mirror is deprecated and removed. All copy operations are serial now, this fixed a number of issues related to session file missing and overall code complexity. * All cli operations now standardize on
Read moreMicrostorage for Microservices
One of the fundamental requirements of microservice is that application containers become stateless. However the states still need to be stored elsewhere, as in databases, object storage, session files, cookies, cache, etc. Microstorage is emerging as a new architecture to address the storage scalability for microservices. Microstorage inherits the idea from microservices that “only small things scale”. Scale-up is not
Read moreCommand-line Access to Google Cloud Storage
Since our September release of MinIO Client ‘mc’ for Amazon S3 and MinIO server, we received number of requests to also support Google cloud storage, Red Hat Ceph and Open Stack Swift. Here is the Amazon S3 API compatibility matrix for various server implementations. * Amazon S3 [https://aws.amazon.com/s3/]: Amazon S3 V4 (latest) and V2 API signature. * Minio
Read more
