Azure-storage-azcopy: Basic telemetry needed - data transferred / progress / %-complete.

[cloudguy23]

Which version of the AzCopy was used?

10.0.4 preview

Note: The version is visible when running AzCopy without any argument

Which platform are you using? (ex: Windows, Mac, Linux)

Linux - CentOS 7.5

What command did you run?

./azcopy cp "${SOURCE}" "${TARGET}"

Note: Please remove the SAS to avoid exposing your credentials. If you cannot remember the exact command, please retrieve it from the beginning of the log file.

What problem was encountered?

No status / telemetry beyond in progress 2-sec average of throughput. Would be great to have a progress % for sync operation or even data transferred (MB/GB/TB/etc).

How can we reproduce the problem in the simplest way?

Run as is.

Have you found a mitigation/solution?

No.

[zezha-msft]

Hi @cloudguy23, thanks for reaching out!

I've logged your suggestion and will discuss with the Team on how to improve progress status.

[artemuwka]

Thank you for taking the time to share your product and documentation feedback with us. Your input is valued and helps us create the right documentation for our customers. Due to the volume of issues in our queue, our policy is to close issues that have been inactive for the last 90 days. We hope to continue hearing from you. Thank you.

[artemuwka]

please-close

[IzuruSenokuchi]

I also want similar features.
I want to get the current progress of any jobID with the jobs show command.
For example, I want to include InProgress in the condition of IsJobDone function.

[JohnRusk]

@IzuruSenokuchi Which would be most useful to you

1. Something like percentage complete (i.e. percentage of the total data volume that has been transferred) OR
2. Something exactly like the end-of-job summary, which shows progress as the number of files that have been transferred. (As you requested in #371 )

[IzuruSenokuchi]

Hi @JohnRusk Thank you for confirmation.
What I want to use is the second solution you presented.
It is very useful if the return value of "summary" can be confirmed by calling ("ex. TotalTransfers, TransfersCompleted, etc ...") by calling ". Azcopy jobs show ".

[JohnRusk]

@IzuruSenokuchi Thanks. That's a good idea and I can see how it would be useful. We'll track that under #371.

[JohnRusk]

@cloudguy23 This issue remains on our backlog to be done. It didn't make the cut for our recent GA release, but we agree that it's important and we haven't forgotten about it!

[JohnRusk]

Note: #371 covers getting the progress of other running jobs, using AzCopy jobs show.

This issue covers a % complete indicator.

[JohnRusk]

This actually looks like a duplicate of #500
In any case, the code is now review #525

[JohnRusk]

Percent complete is now shown, in version 10.3 which is released now. If that's not enough to meet the needs described above, please comment and we'll re-open this issue.