Hybrid Cloud Object Storage
Baremetal
Erasure Code Calculator
Reference Hardware
Stream processing with Apache Flink and MinIO
How to use Apache Flink to build a private cloud data pipeline for a variety of use cases.
Read more...
Modern Data Lake with MinIO : Part 2
In this post we’ll learn more about object storage, specifically Minio and then see how to connect Minio with tools like Apache Spark and Presto for analytics workloads.
Read more...MinIO private cloud on Pivotal Container Service
In this post, we learn about Pivotal Container Service deployment and how to use the pks command line tool to create and manage Kubernetes clusters. We also saw how to deploy Minio once your PKS Kubernetes cluster is set up and running.
Read more...Interactive SQL query with Apache Presto on MinIO Cloud Storage
In this post, we learn about why and how Presto is becoming the tool of choice when querying large datasets from platforms like MinIO. We then learn the steps to setup and deploy Presto on private infrastructure.
Read more...Monitor MinIO server with Prometheus
Minio now has built-in support for exporting Prometheus compatible data on an unauthenticated endpoint. This enables Prometheus monitoring for Minio server deployments without sharing server credentials and eliminates the need to run an external Prometheus exporter.
Read more...IoT data storage and analysis with Fluentd, MinIO and Apache Spark
One of the major requirements for success with IoT strategy is the ability to store and analyze device and sensor data. As IoT brings thousands of devices online everyday, the data being generated by all these devices combined is reaching staggering levels. Storing the IoT data in a scalable yet cost effective manner, while being able to analyze it easily
Read more...Configurable data and parity drives on MinIO server
Erasure coding is a reliable approach to shard data across multiple drives and fetch it back, even when a few of the drives are not available. MinIO server leverages Reed Solomon erasure coding to ensure data redundancy in multiple disk deployments. Until recently the number of drives used for data and parity in MinIO’s erasure coding was fixed to
Read more...Experimental Amazon S3 API support for Backblaze B2 Cloud Storage Service
Some our community members have repeatedly asked for Backblaze B2 Cloud Storage and MinIO integration [1] . B2 is competitively priced and has a huge fan following. We also heard from Backblaze team that they are actively expanding their B2 cloud storage service. We added experimental support for Backblaze B2 backend in MinIO to add S3 compatible API support for their
Read more...MinIO server gauge with Raspberry Pi
Today we’ll take a look at an IoT pressure gauge for your MinIO server. This is a cool hack built by Alex Ellis with the Raspberry Pi, Docker and MinIO. After contributing code to the Open-Source MinIO project to enable webhooks Alex wanted visualize the traffic passing through his server. His hack shows the rate that objects get uploaded
Read more...Containerized data analytics at scale, with MinIO and Pachyderm
Containers running on orchestration platforms like Kubernetes, Docker Swarm, DC/OS et al. offer powerful, versatile ways to deploy applications. Containers let you deploy isolated application instances, and you can launch multiple such instances to scale up your load serving capacity. You don’t even need to worry about individual server capacities and scheduling thanks to orchestration tool, which provide
Read more...Scalable Genomics Data Processing Pipeline with Alluxio, Apache Mesos, and MinIO
This is a guest blog from our friends at Guardant Health. Guardant Health is the world leader in comprehensive liquid biopsy. Oncologists order our blood test to help determine if their advanced cancer patients are eligible for certain drugs that target specific genomic alterations in tumour DNA. Each test produces huge amounts of genomic data that we process into easily
Read more...How to use VMware Harbor with MinIO?
Harbor is an enterprise-class docker registry server to store and distribute container images. Follow this document to use MinIO object storage server as a storage backend for Harbor container registry. PrerequisitesInstall and run MinIO serverdocker run -p 9000:9000 --name minio \ -e "MINIO_ACCESS_KEY=minio" \ -e "MINIO_SECRET_KEY=minio123" \ -v /mnt/minio/export:/export
Read more...Deploy MinIO cloud storage to Mesosphere DC/OS
Container orchestration is gaining traction as the default way to deploy applications. Developers are architecting their modern applications from the ground-up to run in containers, which enables faster deployment and more resilience. Even legacy applications are adopting containers in every way they can to access these advantages. Of the many characteristics that make an application container ready, the way it
Read more...Introducing Webhooks for MinIO
MinIO provides integration with a range of backend systems which enables you to build a complete solution for your projects. The team has recently integrated a pull request from the community to add Webhook support and wanted to tell you a bit about it.
Read more...Set up an automated data backup system with MinIO and CloudBerry
Data loss is more frequent that we think. Whether you lose data from your laptop or a mission critical application server, it can be devastating. You may not have faced it yourself, but think of people close to you — friends, family, colleagues—and you’ll find several instances of people losing critical personal or business data. To avoid such loss,
Read more...Enterprise-Grade Cloud Storage with NGINX Plus and MinIO
In this post, I explain how to use NGINX and NGINX Plus as a reverse proxy and load balancer for MinIO servers.
Read more...Build AWS S3 compatible cloud storage on GCP with Minio and Kubernetes
Applications today generate more data than ever, and this upward trend is expected to keep up in foreseeable future. How do you handle this ever growing storage requirement of your application? A storage solution that can run where your application runs and can scale with it in an automated manner, is the way to go. Add multi-tenant capabilities and it
Read more...Publish Minio events via NATS
IntroductionMinio server supports Amazon S3 compatible bucket event notification for following targets AMQP, Elasticsearch , Redis, nats.io, PostgreSQL and Apache Kafka. Part 4 of this blog series covers sending bucket notifications using NATS. Steps to Configure NATSI used Ubuntu Linux 16.04, gnatsd and nats package. It requires go package installed, for installation steps follow https://docs.minio.io/docs/
Read more...Publish MinIO events via Redis
IntroductionMinio server supports Amazon S3 compatible bucket event notification for following targets AMQP, Elasticsearch , Redis, nats.io, PostgreSQL and Apache Kafka. Part 3 of this blog series covers sending bucket notifications using Redis. Steps to Configure RedisI used Ubuntu Linux 16.04, latest Minio server binary & Redis PPA version 3.0.7 on my laptop for this setup. $ sudo
Read more...Publish Minio events via Elasticsearch
Introduction Minio server supports Amazon S3 compatible bucket event notification for following targets AMQP, Elasticsearch , Redis, nats.io, PostgreSQL and Apache Kafka. Part 2 of this blog series covers sending bucket notifications using Elasticsearch server. Steps to Configure ElasticsearchI used Ubuntu Linux 16.04, latest Minio server binary and Elasticsearch 2.4.0on my laptop for this setup. Note: Elasticsearch
Read more...