Using OpenObserve with MinIO
OpenObserve is an open-source observability platform designed to streamline the monitoring of logs, metrics, and traces.
Read moreMinIO Blog
The Disruptive Nature of Data Lakehouses
Introduction In 1997, Clayton Christensen, in his book The Innovator’s Dilemma, identified a pattern of innovation that tracked the capabilities, cost, and adoption by market segment between an incumbent and a new entrant. He labeled this pattern “Disruptive Innovation.” Not every successful product is disruptive - even if it causes well-established businesses to lose market share or even fail
Read moreUnderstanding the Attack Vector for CVE-2023-28432 and CVE-2023-28434
On September 4th, it was uncovered that an unknown threat actor had attacked publicly available MinIO object storage clusters. The attackers exploited two known security vulnerabilities in the MinIO server: CVE-2023-28432 and CVE-2023-28434 Both vulnerabilities had been reported and fixed on March 19th and 20th, and a new release, RELEASE.2023-03-20T20-16-18Z, was published on the same day. Both CVEs were
Read moreThe Flaw in the Unified Storage Narrative
It seems like more and more companies are touting themselves as one-stop shops for object, file and block storage these days - adopting the mantle of “unified” storage and offering to support a variety of storage protocols. The idea of supporting S3, NFS, SMB, HDFS, iSCSI, FCoE, NVMeoF and FCP all at once, is touted as the epitome of flexibility
Read moreMinIO Adds Manual Rebalancing
You don't have to rebalance data saved to MinIO, but you can if you want to.
Read moreBuilding a Data Lakehouse using Apache Iceberg and MinIO
Introduction In a previous post, I provided an introduction to Apache Iceberg and showed how it uses MinIO for storage. I also showed how to set up a development machine. To do this, I used Docker Compose to install an Apache Spark container as the processing engine, a REST catalog, and MinIO for storage. I concluded with a very simple
Read moreAccelerating MongoDB Backup with MinIO Jumbo
MinIO
MinIO
on
|
MinIO
on
|
Make MongoDB backups faster - upload in parallel with MinIO Jumbo.
Read moreOracle RMAN to MinIO Backup
The Oracle Secure Backup (OSB) cloud module allows you to back up your Oracle Database to a MinIO bucket. It leverages RMAN’s encryption to ensure the security of the database backup.
Read moreSUBNET, Engineering Creativity, and You
When we started MinIO, we set out to set a new standard for object storage. We built a software-defined, S3 API compatible object storage that is the fastest and most scalable solution available that isn’t S3. But we didn’t stop there. We are also crafting an entirely different experience through our SUBNET experience. SUBNET combines a commercial license
Read moreA Developer’s Introduction to Apache Iceberg using MinIO
Introduction Open Table Formats (OTFs) are a phenomenon in the data analytics world that has been gaining momentum recently. The promise of OTFs is as a solution that leverages distributed computing and distributed object stores to provide capabilities that exceed what is possible with a Data Warehouse. The open aspect of these formats gives organizations options when it comes to
Read moreStorage Infrastructure for Automating Configuration Management with Salt and Puppet
Globally there has been a shift to bring applications closer to home. Enterprises want more control of their data and have had enough of paying egress fees to the public cloud to get access to their own data. Besides cost, there is also the matter of security, or lack thereof, when resources are shared with unknown organizations. Vulnerabilities can trickle
Read moreThe Architect’s Guide to Thinking About the Hybrid/Multi Cloud
We were recently asked by a journalist to help frame the challenges and complexity of the hybrid cloud for technology leaders. While we suspect many technologists have given this a fair amount of thought, we also know from first-hand discussions with customers and community members that this is still an area of significant inquiry. We wanted to summarize that thinking
Read moreAnomaly Detection from Log Files: The Performance at Scale Use Case
Driving competitive advantage by employing the best technologies separates great operators from good operators. Discovering the hidden gems in your corporate data and then presenting key actionable insights to your clients will help create an indispensable service for your clients, and isn’t this what every executive wishes to create? Cloud-based data storage (led by the likes of Amazon S3,
Read moreMLflow Tracking and MinIO
Introduction It’s challenging to keep track of machine learning experiments. Let’s say you have a collection of raw files in a MinIO bucket to be used to train and test a model. There will always be multiple ways to preprocess the data, engineer features, and design the model. Given all these options, you will want to run many
Read moreAI/ML Best Practices During a Gold Rush
Introduction The California Gold Rush started in 1848 and lasted until 1855. It is estimated that approximately 300,000 people migrated to California from other parts of the United States and abroad. Economic estimates suggest that, on average, only half made a modest profit. The other half either lost money or broke even. Very few gold seekers made a significant
Read moreMigrate from AWS S3 to MinIO on Equinix Metal
Between the public cloud and your data center exists a middle ground where you can have full control over infrastructure hardware, without the high initial cost of investment.
Read moreHow to Repatriate From AWS S3 to MinIO
MinIO
MinIO
on
|
MinIO
on
|
If S3 costs are burning a hole in your pocket, then it's time to start thinking about running MinIO on-premise for your private cloud.
Read moreSolving the Hybrid-Cloud Challenge - UCE Systems and MinIO
MinIO has partners across the ecosystem - from our cloud partnerships with AWS, GCP, Azure and IBM to more solution-focused partnerships like Snowflake and Dremio. We are pleased to add UCE Systems to our roster of solutions-based partnerships. UCE is a leading consulting firm focused on modern data platforms (like the aforementioned Dremio). UCE has brought dozens of enterprises out
Read moreParallel ML Experimentation leveraging MinIO & lakeFS
Introduction This post was written in collaboration with Iddo Avneri from lakeFS. Managing the growing complexity of ML models and the ever-increasing volume of data has become a daunting challenge for ML practitioners. Efficient data management and data version control are now critical aspects of successful ML workflows. In this blog post, we delve into the power of parallel ML
Read moreGet Started with MinIO on Red Hat OpenShift for a PoC
When we announced the availability of MinIO on Red Hat OpenShift, we didn’t anticipate that demand would be so great that we would someday write a series of blog posts about this powerful combination. This combination is being rapidly adopted due to the ubiquitous nature of on-prem cloud and the need of large organizations wanting to bring their data
Read more
