Myths about Deduplication and Compression

Myths about Deduplication and Compression

A lot of vendors offer compression and deduplication as a feature of their storage solutions. We critically evaluate these claims by looking at the two methods used to reduce the raw disk usage. Compression Overview Compression in overall terms, gets its benefit from reducing redundancy in the data you upload. This means that repeated or otherwise predictable data can be

Read more...

OpenSearchCon 2023 Talk

OpenSearchCon 2023 Talk

Apparently, the OpenSearch folks love MinIO as much as we love OpenSearch, the talk got accepted and we were invited to present it in Seattle. It was very cold in the Northwest but we were very excited nonetheless.

Read more...

Object Detection Made Simple with MinIO and YOLO

Object Detection Made Simple with MinIO and YOLO

Tl;dr: In this post, we will create a custom image dataset and then train a You-Only-Look-Once (YOLO) model for the ubiquitous task of object detection. We will then implement a system using MinIO Bucket Notifications that can automatically perform inference on a new image. Introduction: Computer vision remains an extremely compelling application of artificial intelligence. Whether it’s recognizing

Read more...

The Disruptive Nature of Data Lakehouses

The Disruptive Nature of Data Lakehouses

Introduction In 1997, Clayton Christensen, in his book The Innovator’s Dilemma, identified a pattern of innovation that tracked the capabilities, cost, and adoption by market segment between an incumbent and a new entrant. He labeled this pattern “Disruptive Innovation.” Not every successful product is disruptive - even if it causes well-established businesses to lose market share or even fail

Read more...

Understanding the Attack Vector for CVE-2023-28432 and CVE-2023-28434

On September 4th, it was uncovered that an unknown threat actor had attacked publicly available MinIO object storage clusters. The attackers exploited two known security vulnerabilities in the MinIO server: CVE-2023-28432 and CVE-2023-28434 Both vulnerabilities had been reported and fixed on March 19th and 20th, and a new release, RELEASE.2023-03-20T20-16-18Z, was published on the same day. Both CVEs were

Read more...

SUBNET, Engineering Creativity, and You

SUBNET, Engineering Creativity, and You

When we started MinIO, we set out to set a new standard for object storage. We built a software-defined, S3 API compatible object storage that is the fastest and most scalable solution available that isn’t S3. But we didn’t stop there. We are also crafting an entirely different experience through our SUBNET experience. SUBNET combines a commercial license

Read more...