How to Run Grafana Mimir with MinIO for Persistent Metrics Storage
Learn how to monitor and alert on metrics using Grafana Mimir and save data to MinIO for persistence.
Read moreMinIO Blog
MinIO Network Encryption - It's All Good
Encrypting network traffic is low-hanging fruit when securing IT infrastructure. MinIO follows a pragmatic approach when it comes to TLS. It has to be secure, it has to be performant and it has to be simple. Things that matter In almost all cases, there are just a couple of things we need to take into consideration: * The TLS version. * The
Read moreSimplicity at Scale
Frank Wessels is a founder at Sneller and previously worked at MinIO. Introduction While at MinIO, perhaps the most important lesson that I learned was about simplicity. Simplicity is is paramount if you want to achieve (true) scalability. This permeated MinIO's architecture and software design from front to back and drove, amongst others, the important Sneller decisions that
Read moreAnomaly Detection with R, H20 and MinIO
Learn about anomaly detection and autoencoding with R, H2O and MinIO.
Read moreUsing MinIO as external tables to extend Snowflake
Snowflake is now the de facto standard for cloud data warehouse platforms. It is architected to support a variety of data tasks from pipelines, ETL, analytics and governance. Traditionally, all the data needed to be moved into Snowflake for an enterprise to take advantage of the Snowflake capabilities. Snowflake, however, has understood that enterprises want to integrate their data wherever
Read moreMigrating MinIO Cluster Instances with Zero Downtime and Zero Data Loss
With the advent of cloud computing, ephemeral compute instances have become ubiquitous. This introduces a whole set of challenges around managing the software, applying DevOps principles, addressing security vulnerabilities and ensuring automation. These are mission-critical in order to prevent data theft and service disruption. Addressing security vulnerabilities is particularly challenging as it frequently takes the form of updating and restarting
Read moreIOT, IIOT and Storage at the Edge
IoT applications have been exploding for some time, from the bleeding edge of the network to the factory floor, but now they are reaching critical mass. They already generate lots of data and that amount is increasing. Some of this data is processed locally but much of it needs to be sent someplace for further analysis. In many cases, the
Read moreUsing External Tables to Store and Query Data on MinIO with SQL Server 2022
With the introduction of Microsoft SQL Server 2022 now you can query and store data that is on MinIO. Using a feature called Polybase, this changes the game when it comes to the size and location of usable data.
Read moreTakeaways from Kubecon EU
Kubecon EU in Valencia, Spain was a welcome breath of fresh air for the Kubernetes community. While the Linux Foundation and the CNCF did great work in the pandemic, nothing is quite like seeing your “people” in person. That what Valencia delivered. I don’t know the attendance figures off the top of my head, but having been in Los
Read moreIntroducing DirectPV
DirectPV is a CSI driver for Direct Attached Storage. At the most basic level, it is a distributed persistent volume manager, and not a storage system like SAN or NAS. DirectPV is used to discover, format, mount, schedule and monitor drives across servers. Before we get into the architecture of DirectPV, let’s address why we needed to build it.
Read moreMachine Learning Using H20, R and MinIO
I’ve been working with neural networks and machine learning since the late ‘80. Yes, I’m that old. The first product I bought was California Scientific Software BrainMaker Professional. I loved that product because it got me started with neural networks. I still have it: It was a 3 layer neural network product that came with source code in
Read moreMinIO and Apache Arrow Using R
Arrow here, Arrow there, Arrow everywhere. Seems like currently you can't swing a dead cat without hitting an article or blog post about Apache Arrow. Most seem to be addressing a developer audience and are based on a Python and Spark style development platform. Today I’m going to write about using Apache Arrow with MinIO from the
Read moreHow to Run Apache Druid and Apache Superset with MinIO
Learn how to build a cloud-native analytics and visualization stack backed by MinIO.
Read moreBacking up LXD Instances with LXMIN
LXD is a next generation system container and virtual machine manager for Linux systems from Canonical Ltd. LXD lets you manage your containers with a simple command line tool or via a REST API. LXMIN (lex-min) is a simple backup and restore tool for LXD instances (containers or virtual machines) using MinIO object storage. It provides both a command line
Read moreEnterprise Class NVMe Deployment Considerations
I was recently working with a customer on a performance optimization issue when I became aware of an NMVe phenomena which I had never come across, despite spending decades as a chief technology officer and chief data officer. As I dug into the phenomena, I learned that it is a bit of a shared secret among the NVMe crowd. The
Read moreBlock is Faster than Object Storage and Other Myths
Setting the record straight on how to compare multiple storage technologies.
Read moreBuilding Performant Data Infrastructure with Apache Arrow and MinIO
There is a lot of momentum around Apache Arrow these days. A favorite of developers and data practitioners, its use in business-critical applications has grown considerably and data driven organizations like Dremio, InfluxData, Snowflake, Streamlit, and Tellius are all heavily invested. The drivers of this adoption are superior interoperability, simpler data architectures, greater speed and efficiency, more choice of tools
Read moreErasure Coding 101
Learn how Reed-Solomon erasure coding provides data protection for distributed object storage at scale.
Read moreThe Architect’s Guide to Using AI/ML with Object Storage
This post first appeared in The New Stack. With the constant evolution of the enterprise, machine learning and artificial intelligence have become board-level initiatives. Marketing claims aside, capabilities that seemed almost mythical a few years ago are now taken for granted as AI/ML becomes baked into every software stack and architecture. This is becoming known as AI-first architecture. In
Read moreHow To Deploy Grafana Loki and Save Data to MinIO
Install and configure Loki, Promtail, Grafana and MinIO to quickly get started working with log data.
Read more