Product
MinIO Enterprise Object Store
Overview Architecture
Features
MinIO for Public Cloud
AWS GCS Azure
MinIO for Private Cloud
OpenShift SUSE Rancher Tanzu
MinIO for Baremetal
Linux and Windows
Determine your raw and usable capacity Erasure Code Calculator MinIO's Recommended Hardware Configuration Reference Hardware
Solutions
AI Storage Object storage is powering the AI revolution. Learn how MinIO is leading the AI storage market through performance at scale. Modern Datalakes Modern, multi-engine datalakes depend on object stores that deliver performance at scale. Learn more about this core MinIO use case. Hybrid Cloud Effective multi-cloud storage strategies rely on utilizing architecture and tools that can function seamlessly across diverse environments. Equinix Repatriate your data onto the cloud you control with MinIO on Equinix to lower costs while maintaining public cloud adjacency. Splunk Find out how MinIO is delivering performance at scale for Splunk SmartStores. Snowflake Query and analyze multiple data sources, including streaming data, residing on MinIO with the Snowflake Data Cloud. No need to move the data, just query using SnowSQL. SQL Server Discover how to pair SQL Server 2022 with MinIO to run queries on your data on any cloud - without having to move it. HDFS Migration Modernize and simplify your big data storage infrastructure with high-performance, Kubernetes-native object storage from MinIO. VMware Discover how MinIO integrates with VMware across the portfolio from the Persistent Data platform to TKG and how we support their Kubernetes ambitions. Veeam Learn how MinIO and Veeam have partnered to drive performance and scalability for a variety of backup use cases. Commvault Learn how Commvault and MinIO are partnered to deliver performance at scale for mission critical backup and restore workloads. Integrations Browse our vast portfolio of integrations.
Community
GitHub Join our GitHub open source community: explore, experiment, ask questions, and contribute. Slack Channel The MinIO Community Slack provides an open forum for discussing topics related to MinIO. All support is provided on a best-effort basis.
Docs Blog Resources Training Partner Pricing Download

Command-line Access to Google Cloud Storage

MinIO MinIO MinIO on Open Source

Since our September release of MinIO Client ‘mc’ for Amazon S3 and MinIO server, we received number of requests to also support Google cloud storage, Red Hat Ceph and Open Stack Swift.

Here is the Amazon S3 API compatibility matrix for various server implementations.

Previous release of ‘mc’ only supported latest Amazon S3 V4 API signature. We have now added support for older V2 APIs and tested against Google Cloud Storage service.

This is a step by step guide to access Google cloud storage service using ‘mc’.

Setup a project under Google Developer Console

To access Google Cloud Storage, first step is to create project. Click on the following link, https://console.developers.google.com/storage and scroll down to enable storage option on the sidebar.

The following screen will pop up.

Activate S3 API compatibility

To use mc with google cloud storage, you need to activate the S3 API compatibility. It is OFF by default.

Settings > Interoperability >Enable interoperability access

Once interoperability access is enabled the following screen will pop up.

Click on create new key, It will give you an access key and secret key. Note them down.

How to install mc

Once the above steps are complete, mc is ready for use with Google Cloud Storage.

If you have an old version of mc installed, you can update to a newer release via update command.

  • mc update release

Basic operations via mc on google cloud:

To configure mc to access google cloud storage service, you need to enter the access & secret key along with host information via config command.

NOTE: Google Cloud Storage only supports Legacy Signature Version 2, so you have to pick — S3v2

You may also create an alias for convenience.

  • mb command to make buckets in google cloud.
  • ls command to list buckets & contents
  • cp command to copy files & folders
  • cat Command: Display the contents of files
  • rm Command: Remove a file from existing bucket

To see the complete list of functionality for mc please refer to https://github.com/minio/mc

Alternative to MinIO Client

Google has its own CLI tool called gsutil to access cloud storage. It is written in Python and uses native Google Cloud Storage JSON APIs. Learn more about gsutil at https://cloud.google.com/storage/docs/gsutil?hl=en

Previous Post Next Post
S3 Select Security Modern Data Lakes Apache Presto SQL Performance S3 Brand/Design Golang Programming Cloud Computing Microservices Docker AWS Kubernetes Apache Spark Open Source Benchmarks Integrations SUBNET Edge Computing Sidekick Secure-by-Design Splunk Veeam Intel Apache Nifi Immutability Software Defined Storage VMware Apache Arrow Hybrid Cloud Red Hat OpenShift Multicloud Scalability Cloud Field Day Cloud Native Apache Kafka Architect's Guide Awards Operator's Guide Security Advisory AI/ML AGPLv3 Apache Hadoop SFD Azure GCP Observability Analytics R H20 DirectPV DevOps Apache Iceberg Apache Hudi YouTube Summaries EKS Elastic Load Balancers CI/CD Object Storage Compliance opentelemetry BC/DR Storage Newsletter Predictions Best Practices Dremio New MinIO Features partners Small Files Databases DuckDB PostgreSQL Delta Lake Cloud Repatriation Python Object Lambdas Data Pipelines Cloud Operating Model Webhook ClickHouse Vector Database Events Value Engineering Change Data Capture Enterprise Object Store GitOps Case Study Equinix