Azure-storage-azcopy: Feature / Question: Support for non-AWS S3 endpoints
Which version of the AzCopy was used?
10.3.3.
Which platform are you using? (ex: Windows, Mac, Linux)
Mac & Linux
What command did you run?
azcopy cp
What problem was encountered?
Apparently azcopy detects the source type from the source URL. According to this file (if I read it correctly) the source is detected to be S3 iff it contains string amazonaws.com. This limits the usefulness of azcopy. S3 compatible storage is available from many providers, not just AWS.
How can we reproduce the problem in the simplest way?
By running cp command with any of non-aws object storage providers, such as Digital Ocean, as the source.
Have you found a mitigation/solution?
Not really, no.
massive
All 3 comments
Thanks. Yes, we're aware of this limitation and agree that it would be great to address it.
cc @rpohane
JohnRusk
on 15 Jan 2020
@rpohane When we have an indicative release number for this, can you please update the milestone field?
JohnRusk
on 29 May 2020
Is there any progress on this? I have over 50TB of data I want to move from a non AWS s3 provider to azure and this would be super helpful.
sjdrc
on 15 Oct 2020
Related issues
ayeltsov
路
3Comments
martinwoodward
路
6Comments
alvipeo
路
4Comments
Dikkekip
路
5Comments
amishra-dev
路
5Comments
Most helpful comment
Is there any progress on this? I have over 50TB of data I want to move from a non AWS s3 provider to azure and this would be super helpful.