All posts

Introducing Spark-Select for MinIO Data Lakes

Introducing Spark-Select for MinIO Data Lakes

When early object storage APIs were developed they focused on the efficient storage and retrieval of objects. Amazon’s success with S3 and its implementation of the robust S3 API quickly became the de facto standard for object storage in the cloud. MinIO, recognizing this, invested heavily in creating the most compliant implementation of the S3 API outside of Amazon.

Read more...

MinIO updates from KubeCon

There has been a lot going on MinIO server development front. We recently added support for Disk CachingLarge/Petascale bucketsStorage ClassesWhile features like MinIO bucket federation, revamped MinIO browser UX, Prometheus integration, etc are being actively worked upon and will be available soon. But this doesn’t stop us from keeping out eyes, ears and hearts close to the MinIO

Read more...

MinIO, the ZFS of cloud storage

ZFS is best known for abstracting away the physical storage device boundaries by pooling them together. ZFS completely removed the need to manually handle physical storage or worry about their individual capacities. ZFS is also a pioneer in its ability to detect data corruption and recover if data redundancy is available. However, as we already discussed, traditional filesystems can’t

Read more...