Google Cloud Data Transfer Services

Google Cloud official documentation has a nice table to decide when to use offline or online service that could be considered even while using other public cloud platforms:
click on image for enlarged view


It offers the following Data Transfer Services to choose from based on the scenario:
  1. Online Transfer - drag-n-drop, gsutil and JSON API ingest tools.
  2. Cloud Storage Transfer Service - Transfer your data from one cloud to another.
  3. BigQuery Data Transfer Service - Schedule and automate data transfers from your SaaS applications to Google BigQuery
  4. Transfer Appliance - Securely capture, ship, and upload your data to Google Cloud Storage using the Transfer Appliance 100 TB or 480 TB models.
Some points related to data transfer -
Cloud Storage is a highly-available and durable object store service with no limitations on the number of files stored in a bucket, however each file has a maximum size limit of 5 TB.

Storage Transfer Service currently does not provide guarantees around transfer job performance or latency, and some performance fluctuations are to be expected.

There is a usage fee for each Transfer Appliance option, which includes a certain number of free days of onsite usage, 10 days for 100 TB and 25 days for 480 TB. You pay no data ingest fees into Google Cloud Storage.

gsutil tool is an open-source command-line utility available for Windows, Linux, and Mac. It has no built-in support for network throttling.

Comments