Delve into AI’s next frontier with MinIO S3 Object-Store and SDK, enhancing a Weaviate Retreival Augmented Generation (RAG) Pipeline for robust data management. Discover how to elevate efficiency in AI systems using LangChain, unlocking new dimensions in scalable AI solutions.
Read more...
A MinIO cluster operates as a uniform cluster. This means that any request must be seamlessly handled by any server. As a consequence, servers need to coordinate between themselves. This has so far been handled with traditional HTTP RPC requests - and this has served us well. Whenever server A would like to call server B an HTTP request would
Read more...
We’ll go over how to set up the required infrastructure for integrating GitHub Enterprise packages and actions to use MinIO as a backend. At a high level we’ll need running instances of MinIO and GitHub Enterprise.
Read more...Introduction While MD5 hashing is no longer a good choice when considering a hash function, it is still being used in a great variety of applications. As such any performance improvements that can be made to the MD5 hashing speed are worth considering. Due to recent improvements in SIMD processing (AVX2 and especially AVX512) we are providing a Go md5-simd
Read more...
Introduction JSON has established itself as the "lingua franca" of the web. As such the parsing performance of JSON is hugely important for many applications. Despite the simple and human-friendly nature of JSON, it is not a technically trivial format to parse at high speeds. Recently some new designs have been presented one of which is simdjson [https:
Read more...You may know that Golang offers the ability to name return values. Thus far at MinIO [https://github.com/minio/minio] we have not been using this feature much, but that’ll change since there are some nice hidden benefits as we will explain in this blog post. If you are like us, you may have considerable amounts of code
Read more...Maybe if you are like us at Min [https://github.com/minio/minio]IO, you have every now and then come across ‘autogenerated’ functions in your Golang call stacks and wondered what they are all about? We had a case the other day where the call stack showed something like the following: cmd.retryStorage.ListDir(0x12847c0, 0xc420402e70, 0x1, ...) minio/cmd/
Read more...ToolsLib recently switched to a brand new dashboard [https://toolslib.net/blog/viewpost/2017/02/28/54-welcome-new-dashboard/]. However, behind the scenes, there was another switch happening. We used block based filesystem for underlying storage. However, as we grew, the filesystem was proving difficult to scale. So, we were looking to move from block based storage to an object store system,
Read more...Before beginning with Debugging Goroutines leaks, let me give a small introduction of some fundamentals which will give you a broader perspective of the problem. Concurrent Programming. * Concurrent programming deals with concurrent execution of a program wherein multiple sequential streams of execution run at a time resulting in faster execution of your computations. * It helps in better utilization of multicore
Read more...MinIO provides integration with a range of backend systems which enables you to build a complete solution for your projects. The team has recently integrated a pull request from the community to add Webhook support and wanted to tell you a bit about it.
Read more...Logging remains one of the major concerns among developers. Typically, various components like the web servers, databases store logs at different locations. When something goes wrong, developers need to look all around to find the relevant logs. Wouldn’t it be nice to have your application logs automatically stored at a predefined location. You can do this with Fluentd and
Read more...
on
Open Source
According to an IDC study conducted in 2014, there are approximately 18.5 Million software developers world wide. Though it only accounts for a tiny 0.26% of 7 billion world population, their contribution towards overall economic prosperity and progress is mind boggling. I will publish a series of blog post to understand the developer population in detail. Cartography of
Read more...
Replication
Versioning
Observability
Encryption
Key Management Server
S3 Compatibility
Object Immutability
Catalog
Object Prompt
Identity + Access Mgt
Firewall
AIHub
Lifecycle
Cache
Events and Lambdas
Console
Erasure Code Calculator
Reference Hardware
Integrations with MinIO
Download MinIO Object Store
Events
