Benchmarkdotnet: What the report title and value means?

[kkbruce]

I don't understand report title and value means?

Example:
http://benchmarkdotnet.org/GettingStarted.htm#step-4.-view-results

Mean, StdDev means?
Mean, StdDev, Gen 0, Allocted 'xxx us' value means?

Thanks

[AndreyAkinshin]

• Mean: Average time of all the meaningful measurements
• StdDev: Standard deviation of these measurements
• Gen 0: Amount of garbage collections in generation 0
• Allocated: Allocated memory
• us: Microseconds

In the future, I want to add a legend for each column under the summary table.

[kkbruce]

Hi Andrey

Is big or small us is good?

Example:

Mean | StdDev

1.23 us is good?
or
2.34 us is good?

Thanks your reply.

[AndreyAkinshin]

What do your mean?

A method with Mean = 1.23 us works ~ 2 times faster than a method with Mean = 2.34 us.

[kkbruce]

If report like this:

|Method| Mean |
| A | 1.23 us |
| B | 2.34 us|

Is 1.23 us better?

[AndreyAkinshin]

@kkbruce, yes. See also: http://benchmarkdotnet.org/HowItWorks.htm

[kkbruce]

I see.
Thanks.

[AndreyAkinshin]

@kkbruce,
It seems that the us notation confuses a lot of people (see also https://github.com/dotnet/BenchmarkDotNet/issues/459). I decided to add a hint line about time units in the legend section (see https://github.com/dotnet/BenchmarkDotNet/commit/f14e508e44b510a26cc3ec5aed30ee7843a92baf). So, you will get a line like this:

  1 us  : 1 Microsecond (0.000001 sec)