s3verify performs a series of API calls against an object storage server and checks the responses for AWS S3 signature version 4 compatibility. s3verify is licensed under Apache V2.0 license. Why we built s3verify Amazon Web Service’s (AWS) Simple Storage Service (S3) has emerged as the goto cloud storage, so any new competing service has a strong incentive
Read more
MinIO
on
|
If you are interested in app development for the cloud then Minio Server [https://github.com/minio/minio] is a great choice for storing your data. If you just want to back up and share some of your most important files and images to one or more cloud storage services then Minio Client (mc) is going to be right up
Read more
MinIO
on
|
Doctor uses markdown (MD) format for documentation and github for version control. Use Doctor to aggregate multiple MD files from across repositories into a single documentation site. Doctor is licensed under Apache V2.0 license. See a live demo : https://docs.minio.io [https://docs.minio.io/] docs.minio.ioWhy we built Doctor We wanted a documentation server to simply
Read more
The 64-bit ARMv8 core has introduced new instructions for SHA1 and SHA2 acceleration as part of the Cryptography Extensions [http://infocenter.arm.com/help/index.jsp?topic=/com.arm.doc.ddi0501f/CHDFJBCJ.html] . We at Minio [https://minio.io/] were curious as to the difference that these instructions might make, and this turns out to be one of the nicer
Read more
MinIO
on
|
This article shows you how to configure Elasticsearch to store snapshots and metadata in Minio [http://minio.io]. Minio is an object storage server built for cloud application developers and devops and compatible with Amazon S3 object storage. The current aws cloud plugin of Elasticsearch has been build with an older version of the Amazon SDK, causing several issues. We’
Read moreLogging remains one of the major concerns among developers. Typically, various components like the web servers, databases store logs at different locations. When something goes wrong, developers need to look all around to find the relevant logs. Wouldn’t it be nice to have your application logs automatically stored at a predefined location. You can do this with Fluentd and
Read moreIn this blog we would like to present an optimized implementation, blake2b-simd [https://github.com/minio/blake2b-simd] , in pure Go for the BLAKE2 [https://blake2.net/] hashing algorithm that takes advantage of SIMD instructions. It gives up to a 4x speed increase over the (non-assembly) Go implementation and can achieve hashing speeds close to 1 GB/sec per core on
Read more
Whether you notice it or not, as an end user, storage is an important component of almost all the software we use today. As a developer however, it is important is to be able retrieve stuff in an easy yet secure and fast way. As I mentioned earlier [https://blog.minio.io/object-storage-what-is-it-all-about-62920ca164ca#.wnnc8hyfs] , Object storage is a great way
Read more
In my previous post [https://blog.minio.io/object-storage-what-is-it-all-about-62920ca164ca#.bcz4d4nnd] we learnt the why and what of object storage. Specifically, we learnt why at all a new storage paradigm is required and what it does to alleviate modern unstructured data problems. We saw how object storage lets you access objects at application layer with simple API calls over HTTP(s)
Read more
Traditionally web applications used file systems and databases to store user data in the back-end. It was simple, structured data goes to the database and anything else goes to the file system. This was easy to manage, since rarely an application generated unstructured data — most of the applications took user input in forms and saved the data to database. However,
Read more
MinIO
on
|
This new release adds support for Solaris/Illumos and FreeBSD 64bit Intel. Following is the non exhaustive list of changes in this release. * Parallel code for cp and mirror is deprecated and removed. All copy operations are serial now, this fixed a number of issues related to session file missing and overall code complexity. * All cli operations now standardize on
Read more
One of the fundamental requirements of microservice is that application containers become stateless. However the states still need to be stored elsewhere, as in databases, object storage, session files, cookies, cache, etc. Microstorage is emerging as a new architecture to address the storage scalability for microservices. Microstorage inherits the idea from microservices that “only small things scale”. Scale-up is not
Read moreSince our September release of MinIO Client ‘mc’ for Amazon S3 and MinIO server, we received number of requests to also support Google cloud storage, Red Hat Ceph and Open Stack Swift. Here is the Amazon S3 API compatibility matrix for various server implementations. * Amazon S3 [https://aws.amazon.com/s3/]: Amazon S3 V4 (latest) and V2 API signature. * Minio
Read more> Download latest MinIO client ‘mc’ http://minio.io/#mc [https://minio.io/#mc] MinIO client went through several rewrites to reach this point. We fixed a number of bugs and introduced newer ones. From this release onwards, we will push smaller but frequent updates. Here are some enhancements in this release. Google Cloud Storage [https://cloud.google.com/storage/
Read moreMinIO Client “mc” is a tool for Amazon S3 compatible cloud storage and POSIX compatible filesystems. It implements basic Unix commands such as ls, cp, cat and diff. mc is entirely written in Golang and released under Apache License, Version 2.0. Project is hosted at Github — https://github.com/minio/mc NAME: mc - MinIO Client for cloud storage
Read moreAccording to an IDC study conducted in 2014, there are approximately 18.5 Million software developers world wide. Though it only accounts for a tiny 0.26% of 7 billion world population, their contribution towards overall economic prosperity and progress is mind boggling. I will publish a series of blog post to understand the developer population in detail. Cartography of
Read more
MinIO
on
|
“The less I needed, the better I felt.” ~ Charles Bukowski We often forget to learn from our successful projects in the past. If you are old enough like me, you will remember a project called qmail. Nobody could poke a hole in its security because of its minimalist design (qmail security guarantee [http://cr.yp.to/qmail/guarantee.html]). Sysadmins
Read more