We are living in a transformative era defined by information and AI. Massive amounts of data are generated and collected every day to feed these voracious, state-of-the-art, AI/ML algorithms. The more data, the better the outcomes. One of the frameworks that has emerged as the lead industry standards is Google's TensorFlow. Highly versatile, one can get started
Read more
Overview MinIO and Splunk have a symbiotic relationship when it comes to enterprise data. Splunk uses MinIO in its Digital Stream Processor. MinIO is a Splunk SmartStore endpoint. In this post we explain how to use Splunk's advanced log analytics to help understand the performance of the MinIO object storage suite and the data under management. A quick
Read more
KES is a stateless and distributed key-management system for high-performance applications. We built KES as the bridge between modern applications - running as containers on Kubernetes - and centralized KMS solutions. Therefore, KES has been designed to be simple, scalable and secure by default.
Read more
With the announcement that MinIO was Veeam Ready for Object last week we felt it would be helpful to circle back and talk about an additional use case. In our first post we covered backups of VMware ESX. An equally popular use case is Veeam Backup for Office (VBO). The Office backup market is massive. Even with the advent of
Read moreIntroduction While MD5 hashing is no longer a good choice when considering a hash function, it is still being used in a great variety of applications. As such any performance improvements that can be made to the MD5 hashing speed are worth considering. Due to recent improvements in SIMD processing (AVX2 and especially AVX512) we are providing a Go md5-simd
Read more
Veeam's V10 release adds object storage support in a big way. Find out how these two software stacks play together to deliver performance oriented backup and restore.
Read more
Almost all of the modern cloud-native applications use HTTPs as their primary transport mechanism even within the network. Every service is a collection of HTTPs endpoints provisioned dynamically at scale. Traditional load balancers that are built for serving web applications across the Internet are at a disadvantage here since they use old school DNS round-robin techniques for load balancing and
Read more
Edge computing is a hot topic and carries with it some confusion, particularly around storage. Handling data properly at the edge can ensure a scalable, cost-effective and secure infrastructure - but failing to set up the right architecture can lead to data loss, security vulnerabilities and sky-high costs related to the bandwidth needed to transfer data repeatedly to and from
Read more
There are two forces that are fundamentally remaking the technology landscape today. One is Kubernetes and the other is high performance Object Storage. They are powering (or are shaped by, depending on your perspective) modern, data-rich applications that include AI/ML and application logs. Either way, modern applications need Kubernetes and Object Storage and Kubernetes and Object Storage owe their
Read more
Introduction JSON has established itself as the "lingua franca" of the web. As such the parsing performance of JSON is hugely important for many applications. Despite the simple and human-friendly nature of JSON, it is not a technically trivial format to parse at high speeds. Recently some new designs have been presented one of which is simdjson by
Read more
The healthcare industry is unique in so many ways. To begin with, it lacks a common objective function on which to optimize. This is because different healthcare organizations, both payers and providers, value different things. Profitability is not the universal goal - there are teaching hospitals, faith-based hospitals and not-for-profit insurance plans. Consider also that a large portion of the
Read more
Kubernetes has fundamentally altered the traditional application development and deployment patterns. Application development teams can now develop, test and deploy their apps in days, across different environments, all within their Kubernetes clusters. Previous generations of technology typically took weeks if not months. This acceleration is possible due to the abstraction that Kubernetes brings to the table, i.e. it deals
Read more
Most developers don’t love managing infrastructure — including storage infrastructure. One of the great things about Kubernetes is the ability to simplify infrastructure management so that developers can focus on creating applications and let Kubernetes handle orchestration. Kubernetes does not natively manage storage infrastructure — but using MinIO and Kubernetes together can help provide the storage that applications need with the
Read more
As data has grown, so has the challenge associated with moving it. Indeed, the bandwidth costs to migrate a PB of data out of AWS would be more than keeping it there for years. Still, customers often need to move large amounts (100s of TBs up to PBs) with some frequency. Amazon knows this and has, in their intensely customer
Read more
The hyper-connected Philipe Nicolas [https://www.linkedin.com/in/phnicolas/] is the editor of the Storage Newsletter [https://www.storagenewsletter.com/]. Each year he asks the leaders in the industry to weigh in with their predictions [https://www.storagenewsletter.com/?s=predictions] on what will transpire in the coming year. The list of companies is long and the respondents are
Read more
MinIO provides the best-in-class performance as we have repeatedly shown in our previous benchmarks. In those benchmarks, we chose the highest-end hardware and measured if MinIO could squeeze out every bit of the resources afforded it. This proved two key points: 1. Ensuring that MinIO utilizes the maximum possible CPU, Network, and Storage available. 2. Ensuring that MinIO is NOT
Read more
This year’s Kubecon was the biggest yet on almost every vector: attendance, announcements and keynotes :). In between all of that were some stark themes on the state of the movement, the evolving vendor landscape and the challenges ahead. While there are some great summaries, we wanted to share our thoughts on what we saw and what we think the
Read more
As a general rule, when people think about object storage they think about one thing — the price per TB/GB. Though a legitimate cost metric, it has the effect of making object storage one-dimensional and relegates it to archival use cases. Further, it distorts the value associated with this increasingly important part of the enterprise tech stack. Frankly, the legacy
Read moreThe fact that MinIO is fast is not a secret. We routinely publish our benchmarks and have put out comparision work against HDFS and AWS (Spark + Presto) in addition to our HDD and NVMe numbers. We recently discovered the availability of large NVMe instances on AWS. Larger than we have ever seen in fact. We procured 32 units of i3en.
Read more
If you handle data of any kind, you have to worry about data security. This is true for multinational banks; it’s also true for small and medium-size businesses. Encryption should never be your only line of defense against malicious actors, but it is one of the most basic security best practices that every organization should consider essential. However, not
Read more