Data transfer from other Cloud Providers
This is an automated way of handling the data transfer between the GCS buckets, other storage solutions like AWS S3 or any HTTPS server. We can use this service for transferring the data across the cloud as well as moving from on-premise to cloud.
We can schedule the data transfer job and also filter specific data that will be imported. For typical data transfer between on-premise to cloud or transfer across the buckets, gsutil is an appropriate option. If we want to move data from AWS/Azure/HTTPS servers to GCP, then this service will be a recommended approach.
Go to the storage, data transfer service and create the job.
If we transfer the data from S3, select the bucket along with access and the secret key.
Make sure to have appropriate permission to access the files from GCS,
Once the job is complete, verify the object in target,
If we want to transfer the data from another bucket, go ahead with below options
There are additional filters where we can include/exclude certain files based on the prefixes and also by the last-modified time range.
Select the destination bucket with transfer options as per the requirement,
Run the job now,
Once the job triggered, wait for the status turns to complete state,
Verify the copied objects in the target bucket,
That is it. I hope this is clear. Please do follow the next posts for more readings. Thank you.