How to Run Apache Druid and Apache Superset with MinIO

Learn how to build a cloud-native analytics and visualization stack backed by MinIO.
Read more...Learn how to build a cloud-native analytics and visualization stack backed by MinIO.
Read more...LXD is a next generation system container and virtual machine manager for Linux systems from Canonical Ltd. LXD lets you manage your containers with a simple command line tool or via a REST API. LXMIN (lex-min) is a simple backup and restore tool for LXD instances (containers or virtual machines) using MinIO object storage. It provides both a command line
Read more...MinIO is deprecating the gateway and will be completely removed in six months. This should not come as a surprise, we began informing the community in 2020 and have steadily removed unpopular gateways. In the last ten months, MinIO has only made bug fixes. The community can continue to use older versions of MinIO past that date. We also encourage
Read more...How to pair fast and efficient search with high-performance Kubernetes-native object storage.
Read more...With RELEASE.2021-05-11T23-27-41Z MinIO has completed its transition to the GNU Affero General Public License v3.0 (GNU AGPL v3) license, meaning that the server, client and gateway will also be licensed under GNU AGPL v3. You can read more about the license from Free Software Foundation and the Open Source Initiative. The client SDKs will remain under Apache v2
Read more...With the introduction of Apache Arrow, language-independent columnar memory format for flat and hierarchical data, organized for efficient analytic operations, MinIO data lakes can be much more powerful. This article explains how to make use of Apache Arrow by using ArrowRDD.
Read more...Once we have convinced you of why you should pay for free software, the next question becomes: “what is the value of what I am getting from my subscription?” The MinIO Subscription Network is not one thing - rather it is a collection of technology, talent and licensing that creates a unique value proposition - one that will not be
Read more...By introducing the ability to subscribe to our software online we obviously invite the question: “why should I pay for free software?” There are two conditions and three reasons: The conditions under which you should pay for free software: MinIO is the primary storage system for your organization (e.g. production)The data stored in MinIO is a critical part
Read more...With another Strata in the rearview mirror, it is time to reflect on what we saw and heard during the week. Strata is clearly a data science show at this point but data science is broad topic. Our perspective, as a provider of high performance object storage, is framed accordingly and we focus on the data stack more than we
Read more...The demise of Hadoop is probably overblown. It will not suddenly disappear from the enterprise landscape - there are simply too many clients, too much sunk investment for it to vanish into the night. What is not overblown is the fact that Hadoop, like countless technologies before it, is in secular, irreversible decline. There are a number of reasons but
Read more...We approach things differently here at MinIO. When we started in 2014, we questioned everything about the object storage market as we built our product - thinking more like a data company than a storage company. We did it from scratch, using engineering first principles, an extraordinary attention to detail and a relentless pursuit of simplicity. We paid careful attention
Read more...Software isn't usually described as bombproof. Particularly the type of software that is responsible for large analytic jobs or machine learning workloads. The words “finicky”, “complex” or in the case of good marketing “professional grade” (meaning you need years of study and multiple certifications) are more common. Bombproof software, however, is one of the many benefits associated with active open
Read more...This is a guest blog from our friends at Guardant Health. Guardant Health is the world leader in comprehensive liquid biopsy. Oncologists order our blood test to help determine if their advanced cancer patients are eligible for certain drugs that target specific genomic alterations in tumour DNA. Each test produces huge amounts of genomic data that we process into easily
Read more...ToolsLib recently switched to a brand new dashboard. However, behind the scenes, there was another switch happening. We used block based filesystem for underlying storage. However, as we grew, the filesystem was proving difficult to scale. So, we were looking to move from block based storage to an object store system, when we found MinIO. After initial analysis, MinIO looked
Read more...Container orchestration is gaining traction as the default way to deploy applications. Developers are architecting their modern applications from the ground-up to run in containers, which enables faster deployment and more resilience. Even legacy applications are adopting containers in every way they can to access these advantages. Of the many characteristics that make an application container ready, the way it
Read more...MinIO provides integration with a range of backend systems which enables you to build a complete solution for your projects. The team has recently integrated a pull request from the community to add Webhook support and wanted to tell you a bit about it.
Read more...IntroductionMinio server supports Amazon S3 compatible bucket event notification for following targets AMQP, Elasticsearch , Redis, nats.io, PostgreSQL and Apache Kafka. Part 4 of this blog series covers sending bucket notifications using NATS. Steps to Configure NATSI used Ubuntu Linux 16.04, gnatsd and nats package. It requires go package installed, for installation steps follow https://docs.minio.io/docs/
Read more...IntroductionMinio server supports Amazon S3 compatible bucket event notification for following targets AMQP, Elasticsearch , Redis, nats.io, PostgreSQL and Apache Kafka. Part 3 of this blog series covers sending bucket notifications using Redis. Steps to Configure RedisI used Ubuntu Linux 16.04, latest Minio server binary & Redis PPA version 3.0.7 on my laptop for this setup. $ sudo
Read more...Since our September release of MinIO Client ‘mc’ for Amazon S3 and MinIO server, we received number of requests to also support Google cloud storage, Red Hat Ceph and Open Stack Swift. Here is the Amazon S3 API compatibility matrix for various server implementations. Amazon S3: Amazon S3 V4 (latest) and V2 API signature.Minio Server: Amazon S3 V4 API
Read more...Download latest MinIO client ‘mc’ http://minio.io/#mcMinIO client went through several rewrites to reach this point. We fixed a number of bugs and introduced newer ones. From this release onwards, we will push smaller but frequent updates. Here are some enhancements in this release. Google Cloud Storage, OpenStack Swift, Red Hat Ceph and most other object storage vendors
Read more...