DirectPV is a CSI driver for Direct Attached Storage. At the most basic level, it is a distributed persistent volume manager, and not a storage system like SAN or NAS. DirectPV is used to discover, format, mount, schedule and monitor drives across servers. Before we get into the architecture of DirectPV, let’s address why we needed to build it.
Read more
I’ve been working with neural networks and machine learning since the late ‘80. Yes, I’m that old. The first product I bought was California Scientific Software BrainMaker Professional. I loved that product because it got me started with neural networks. I still have it: It was a 3 layer neural network product that came with source code in
Read more
Arrow here, Arrow there, Arrow everywhere. Seems like currently you can't swing a dead cat without hitting an article or blog post about Apache Arrow. Most seem to be addressing a developer audience and are based on a Python and Spark style development platform. Today I’m going to write about using Apache Arrow with MinIO from the
Read more
Learn how to build a cloud-native analytics and visualization stack backed by MinIO.
Read more
LXD is a next generation system container and virtual machine manager for Linux systems from Canonical Ltd. LXD lets you manage your containers with a simple command line tool or via a REST API. LXMIN (lex-min) is a simple backup and restore tool for LXD instances (containers or virtual machines) using MinIO object storage. It provides both a command line
Read more
I was recently working with a customer on a performance optimization issue when I became aware of an NMVe phenomena which I had never come across, despite spending decades as a chief technology officer and chief data officer. As I dug into the phenomena, I learned that it is a bit of a shared secret among the NVMe crowd. The
Read more
Setting the record straight on how to compare multiple storage technologies.
Read more
There is a lot of momentum around Apache Arrow these days. A favorite of developers and data practitioners, its use in business-critical applications has grown considerably and data driven organizations like Dremio, InfluxData, Snowflake, Streamlit, and Tellius are all heavily invested. The drivers of this adoption are superior interoperability, simpler data architectures, greater speed and efficiency, more choice of tools
Read more
MinIO
on
|
Learn how Reed-Solomon erasure coding provides data protection for distributed object storage at scale.
Read more
This post first appeared in The New Stack. With the constant evolution of the enterprise, machine learning and artificial intelligence have become board-level initiatives. Marketing claims aside, capabilities that seemed almost mythical a few years ago are now taken for granted as AI/ML becomes baked into every software stack and architecture. This is becoming known as AI-first architecture. In
Read more
Install and configure Loki, Promtail, Grafana and MinIO to quickly get started working with log data.
Read more
Kubeflow is a modern solution to design, build and orchestrate Machine Learning pipelines using the latest and most popular frameworks. Out of the box, Kubeflow ships with MinIO inside to store all of its pipelines, artifacts and logs, however that MinIO is limited to a single PVC and thus cannot benefit from all the features a distributed MinIO brings to
Read moreWe are in a cloud native talent crisis. It is not going to end soon. Given the depth of the crisis, it is pretty amazing to consider how quickly the cloud operating model has grown – from the public cloud to the private cloud and even out to the edge. Our clients and partners are all angling for more cloud talent.
Read more
We recently benchmarked MinIO S3 performance on the Western Digital OpenFlex Data24 using the WARP benchmark tool. Western Digital’s OpenFlex Data24 NVMe-oF Storage Platform extends the high performance of NVMe flash to shared storage. It provides low-latency sharing of NVMe SSDs over a high-performance Ethernet fabric to deliver similar performance to locally attached NVMe SSDs. Industry-leading connectivity, using Western
Read more
Learn how to add external TLS certificates to MinIO tenants and access them using SNI.
Read more
MinIO
on
|
Take advantage of MinIO’s performance, data protection and S3 API functionality for log management and analysis.
Read more
At MinIO, we are on a mission and we won’t stop until everyone can run the resilient, performant and scalable object storage that has taken the cloud by storm. There are already millions of MinIO deployments across the public cloud, private cloud and edge - and we are making it even easier to run S3 API compliant and Kubernetes
Read more
Modern infrastructure is all about availability. * Consider an online mortgage business. A provider has 30 seconds to provide a quote to a prospective buyer or another provider will win the customer’s business. * For online retailers, the weeks between Thanksgiving and New Year’s account for up to 25% of their annual revenue. * The SLAs that customers expect from an
Read more
Primary storage is the storage your application talks to. In the cloud operating model that primarily object storage. Anyone who tells you differently is trying to sell you something.
Read more
We just finished up our Storage Field Day presentation last week and one thing that was clear - there are a lot of folks in the analyst community that continue to be invested in the success of SAN/NAS. On the one hand we understand. There are far more companies in the SAN/NAS universe than there are in the
Read more
