Product
AiStor Logo
Overview
What is AIStor?
Features
Replication Replication Versioning Versioning Observability Observability Encryption Encryption Key Management Server Key Management Server S3 Compatibility S3 Compatibility Object Immutability Object Immutability Catalog Catalog Object Prompt Object Prompt xxx Identity + Access Mgt Firewall Firewall AIHub AIHub Lifecycle Lifecycle Cache Cache Events and Lambdas Events and Lambdas Console Console
Tools
Erasure Code Calculator Erasure Code Calculator Determine your raw and usable capacity across a range of erasure coding settings. Reference Hardware Reference Hardware MinIO’s recommended Configuration and reference hardware for building large scale data infrastructure.
Solutions
AI Storage Learn how MinIO is leading the AI storage market from its exclusive features to performance at scale. HDFS Migration Modernize and simplify your big data storage infrastructure with cloud native storage with AIStor. Snowflake Learn how to leverage Snowflake external tables to query data without having to move it.
Integrations Integrations with MinIO Browse our expansive list of
integrations with links to the relevant
documentation.
Veeam Learn how MinIO and Veeam have partnered deliver superior RTO and RPO. Modern Datalakes Learn how modern, multi-engine data lakeshouses depend on MinIO's AIStor. Equinix Repatriate your data onto the cloud you control with MinIO and Equinix. SQL Server Learn how to leverage SQL Server 2022 with MinIO to run queries on your data without having to move it. Commvault Learn how Commvault and MinIO are partnered to deliver performance at scale for mission critical backup and restore workloads. Hybrid Cloud Learn how enterprises use MinIO to build AI data infrastructure that runs on any cloud - public, private or colo. Splunk Find out how MinIO is delivering performance at scale for Splunk SmartStores. VMware Discover how MinIO integrates with VMware across the portfolio from the Persistent Data platform to TKG and how we support their Kubernetes ambitions.
Open Source
Github Community Explore, experiment, ask questions and contribute. Docs Development guides. Slack Channel Open Forum for discussing topics related to MinIO.
Download MinIO Object Store Download MinIO Object Store Get MinIO's open source server, client, and SDK.
Resources
Resources Home Browse our library of white papers, solution briefs, benchmarks and videos. Blog Product updates, company news, and educational content. Training Learn the MinIO Way and Become a Data Infrastructure Expert.
Events Events Join us to take advantage to meet with MinIO partners, employees, and subject-matter experts.
Partner Pricing
Login Download

ToolsLib switches to MinIO for scale and performance

Nitish Tiwari Nitish Tiwari on Cloud Computing

ToolsLib recently switched to a brand new dashboard. However, behind the scenes, there was another switch happening. We used block based filesystem for underlying storage. However, as we grew, the filesystem was proving difficult to scale.

So, we were looking to move from block based storage to an object store system, when we found MinIO. After initial analysis, MinIO looked perfect for our requirements and we switched to MinIO.

Not only the switch was smooth, team is very happy with the new storage system. We thought this was a great success story for open source software and needed to be shared with our community.

ToolsLib

ToolsLib offers software hosting and related project management services for developers. ToolsLib enables easy access to daily use software via simple download and publishing options.

Situation

We used to store all of our unstructured data on a block based filesystem. While the filesystem served us well initially, as we grew it was proving difficult to scale. Also, the block based filesystem was difficult to synchronize in a reliable way between several servers, creating a bottleneck in our overall operations.

Solution

Object storage is more suited to organize our data, a bucket represents a project which stores several files — it was much easier for them to manage using this abstraction than using traditional folders.

Currently, we have deployed a single MinIO server with 16GB RAM, running two SSDs in RAID1 configuration. MinIO server already hosts several GB of data, and manages between 10 to 50 requests per second. Since the software stack is in PHP, we use the AWS PHP SDK. The upload is using multipart with a filesize up to 1.5GB and a stream on the download side.

Some of very popular software in our library create huge request peak in very few seconds. To handle that load efficiently and monitor it pro-actively we usemc events and mc watch.

The migration has allowed us to simplify our storage management, while giving flexibility to develop services.

To learn about other projects/companies that use MinIO, check out Awesome MinIO.

While you’re at it, help us understand your use case and how we can help you better! Fill out our best of MinIO deployment form (takes less than a minute), and get a chance to be featured on the MinIO website and showcase your MinIO private cloud design to MinIO community.

This post was originally published on ToolsLib blog, it is reproduced on MinIO blog with proper permissions.