Product
AiStor Logo
Overview
What is AIStor?
Features
Replication Replication Versioning Versioning Observability Observability Encryption Encryption Key Management Server Key Management Server S3 Compatibility S3 Compatibility Object Immutability Object Immutability Catalog Catalog Object Prompt Object Prompt xxx Identity + Access Mgt Firewall Firewall AIHub AIHub Lifecycle Lifecycle Cache Cache Events and Lambdas Events and Lambdas Console Console
Tools
Erasure Code Calculator Erasure Code Calculator Determine your raw and usable capacity across a range of erasure coding settings. Reference Hardware Reference Hardware MinIO’s recommended Configuration and reference hardware for building large scale data infrastructure.
Solutions
AI Storage Learn how MinIO is leading the AI storage market from its exclusive features to performance at scale. HDFS Migration Modernize and simplify your big data storage infrastructure with cloud native storage with AIStor. Snowflake Learn how to leverage Snowflake external tables to query data without having to move it.
Integrations Integrations with MinIO Browse our expansive list of
integrations with links to the relevant
documentation.
Veeam Learn how MinIO and Veeam have partnered deliver superior RTO and RPO. Modern Datalakes Learn how modern, multi-engine data lakeshouses depend on MinIO's AIStor. Equinix Repatriate your data onto the cloud you control with MinIO and Equinix. SQL Server Learn how to leverage SQL Server 2022 with MinIO to run queries on your data without having to move it. Commvault Learn how Commvault and MinIO are partnered to deliver performance at scale for mission critical backup and restore workloads. Hybrid Cloud Learn how enterprises use MinIO to build AI data infrastructure that runs on any cloud - public, private or colo. Splunk Find out how MinIO is delivering performance at scale for Splunk SmartStores. VMware Discover how MinIO integrates with VMware across the portfolio from the Persistent Data platform to TKG and how we support their Kubernetes ambitions.
Open Source
Github Community Explore, experiment, ask questions and contribute. Docs Development guides. Slack Channel Open Forum for discussing topics related to MinIO.
Download MinIO Object Store Download MinIO Object Store Get MinIO's open source server, client, and SDK.
Resources
Resources Home Browse our library of white papers, solution briefs, benchmarks and videos. Blog Product updates, company news, and educational content. Training Learn the MinIO Way and Become a Data Infrastructure Expert.
Events Events Join us to take advantage to meet with MinIO partners, employees, and subject-matter experts.
Partner Pricing
Login Download

Command-line Access to Google Cloud Storage

MinIO MinIO MinIO on Open Source

Since our September release of MinIO Client ‘mc’ for Amazon S3 and MinIO server, we received number of requests to also support Google cloud storage, Red Hat Ceph and Open Stack Swift.

Here is the Amazon S3 API compatibility matrix for various server implementations.

Previous release of ‘mc’ only supported latest Amazon S3 V4 API signature. We have now added support for older V2 APIs and tested against Google Cloud Storage service.

This is a step by step guide to access Google cloud storage service using ‘mc’.

Setup a project under Google Developer Console

To access Google Cloud Storage, first step is to create project. Click on the following link, https://console.developers.google.com/storage and scroll down to enable storage option on the sidebar.

The following screen will pop up.

Activate S3 API compatibility

To use mc with google cloud storage, you need to activate the S3 API compatibility. It is OFF by default.

Settings > Interoperability >Enable interoperability access

Once interoperability access is enabled the following screen will pop up.

Click on create new key, It will give you an access key and secret key. Note them down.

How to install mc

Once the above steps are complete, mc is ready for use with Google Cloud Storage.

If you have an old version of mc installed, you can update to a newer release via update command.

  • mc update release

Basic operations via mc on google cloud:

To configure mc to access google cloud storage service, you need to enter the access & secret key along with host information via config command.

NOTE: Google Cloud Storage only supports Legacy Signature Version 2, so you have to pick — S3v2

You may also create an alias for convenience.

  • mb command to make buckets in google cloud.
  • ls command to list buckets & contents
  • cp command to copy files & folders
  • cat Command: Display the contents of files
  • rm Command: Remove a file from existing bucket

To see the complete list of functionality for mc please refer to https://github.com/minio/mc

Alternative to MinIO Client

Google has its own CLI tool called gsutil to access cloud storage. It is written in Python and uses native Google Cloud Storage JSON APIs. Learn more about gsutil at https://cloud.google.com/storage/docs/gsutil?hl=en