Runtime: Performance regression: few Span Indexer benchmarks are 30% slower

Created on 16 Jul 2019 · 14Comments · Source: dotnet/runtime

Some of the Span Indexer benchmarks are 30% slower when compared to 2.2.

https://github.com/dotnet/performance/blob/master/src/benchmarks/micro/coreclr/Span/Indexer.cs

Repro

git clone https://github.com/dotnet/performance.git
cd performance
# if you don't have cli installed and want python script to download the latest cli for you
py .\scripts\benchmarks_ci.py -f netcoreapp2.2 netcoreapp3.0 --filter *IndexerBench*
# if you do
dotnet run -p .\src\benchmarks\micro\MicroBenchmarks.csproj -c Release -f netcoreapp2.2 --filter *IndexerBench* --runtimes netcoreapp2.2 netcoreapp3.0

BenchmarkDotNet=v0.11.3.1003-nightly, OS=Windows 10.0.18362
Intel Xeon CPU E5-1650 v4 3.60GHz, 1 CPU, 12 logical and 6 physical cores
.NET Core SDK=3.0.100-preview8-013262
   [Host]     : .NET Core 2.2.6 (CoreCLR 4.6.27817.03, CoreFX 4.6.27818.02), 64bit RyuJIT
   Job-BYJCMJ : .NET Core 2.2.6 (CoreCLR 4.6.27817.03, CoreFX 4.6.27818.02), 64bit RyuJIT
   Job-JSSCYO : .NET Core 3.0.0-preview8-27916-02 (CoreCLR 4.700.19.36302, CoreFX 4.700.19.36514), 64bit RyuJIT

| Method | Toolchain | length | Mean | Ratio |
|----------------- |-------------- |------- |-----------:|------:|
| Ref | netcoreapp2.2 | 1024 | 426.5 ns | 1.00 |
| Ref | netcoreapp3.0 | 1024 | 548.0 ns | 1.28 |
| | | | | |
| Fixed1 | netcoreapp2.2 | 1024 | 422.8 ns | 1.00 |
| Fixed1 | netcoreapp3.0 | 1024 | 545.8 ns | 1.29 |
| | | | | |
| Fixed2 | netcoreapp2.2 | 1024 | 424.3 ns | 1.00 |
| Fixed2 | netcoreapp3.0 | 1024 | 546.4 ns | 1.29 |
| | | | | |
| Indexer1 | netcoreapp2.2 | 1024 | 424.2 ns | 1.00 |
| Indexer1 | netcoreapp3.0 | 1024 | 546.5 ns | 1.29 |
| | | | | |
| Indexer2 | netcoreapp2.2 | 1024 | 425.0 ns | 1.00 |
| Indexer2 | netcoreapp3.0 | 1024 | 545.6 ns | 1.28 |
| | | | | |
| Indexer3 | netcoreapp2.2 | 1024 | 421.0 ns | 1.00 |
| Indexer3 | netcoreapp3.0 | 1024 | 545.0 ns | 1.29 |
| | | | | |
| Indexer4 | netcoreapp2.2 | 1024 | 4,162.4 ns | 1.00 |
| Indexer4 | netcoreapp3.0 | 1024 | 5,453.6 ns | 1.31 |
| | | | | |
| Indexer5 | netcoreapp2.2 | 1024 | 492.8 ns | 1.00 |
| Indexer5 | netcoreapp3.0 | 1024 | 551.0 ns | 1.12 |
| | | | | |
| Indexer6 | netcoreapp2.2 | 1024 | 548.7 ns | 1.00 |
| Indexer6 | netcoreapp3.0 | 1024 | 550.4 ns | 1.00 |
| | | | | |
| ReadOnlyIndexer1 | netcoreapp2.2 | 1024 | 422.7 ns | 1.00 |
| ReadOnlyIndexer1 | netcoreapp3.0 | 1024 | 547.6 ns | 1.29 |
| | | | | |
| ReadOnlyIndexer2 | netcoreapp2.2 | 1024 | 419.7 ns | 1.00 |
| ReadOnlyIndexer2 | netcoreapp3.0 | 1024 | 546.9 ns | 1.30 |
| | | | | |
| WriteViaIndexer1 | netcoreapp2.2 | 1024 | 1,602.3 ns | 1.00 |
| WriteViaIndexer1 | netcoreapp3.0 | 1024 | 1,607.8 ns | 1.00 |
| | | | | |
| WriteViaIndexer2 | netcoreapp2.2 | 1024 | 581.7 ns | 1.00 |
| WriteViaIndexer2 | netcoreapp3.0 | 1024 | 583.5 ns | 1.00 |
| | | | | |
| KnownSizeArray | netcoreapp2.2 | 1024 | 416.8 ns | 1.00 |
| KnownSizeArray | netcoreapp3.0 | 1024 | 545.5 ns | 1.31 |
| | | | | |
| KnownSizeCtor | netcoreapp2.2 | 1024 | 417.5 ns | 1.00 |
| KnownSizeCtor | netcoreapp3.0 | 1024 | 544.0 ns | 1.30 |
| | | | | |
| KnownSizeCtor2 | netcoreapp2.2 | 1024 | 426.4 ns | 1.00 |
| KnownSizeCtor2 | netcoreapp3.0 | 1024 | 486.2 ns | 1.14 |
| | | | | |
| SameIndex1 | netcoreapp2.2 | 1024 | 693.3 ns | 1.00 |
| SameIndex1 | netcoreapp3.0 | 1024 | 787.4 ns | 1.14 |
| | | | | |
| SameIndex2 | netcoreapp2.2 | 1024 | 820.6 ns | 1.00 |
| SameIndex2 | netcoreapp3.0 | 1024 | 821.9 ns | 1.00 |
| | | | | |
| CoveredIndex1 | netcoreapp2.2 | 1024 | 977.9 ns | 1.00 |
| CoveredIndex1 | netcoreapp3.0 | 1024 | 978.1 ns | 1.00 |
| | | | | |
| CoveredIndex2 | netcoreapp2.2 | 1024 | 833.1 ns | 1.00 |
| CoveredIndex2 | netcoreapp3.0 | 1024 | 825.5 ns | 0.99 |
| | | | | |
| CoveredIndex3 | netcoreapp2.2 | 1024 | 1,098.8 ns | 1.00 |

/cc @AndyAyersMS @danmosemsft

category:cq
theme:register-allocator
skill-level:expert
cost:large

area-CodeGen-coreclr tenet-performance

Source

adamsitnik

All 14 comments

I've verified that this is not an array alignment issue. I've sent https://github.com/dotnet/performance/pull/667 to make sure we always use unaligned arrays and compare apples to apples.

adamsitnik on 16 Jul 2019

/cc @billwert @DrewScoggins

adamsitnik on 16 Jul 2019

This shows up pretty clearly in the old benchview data (showing ubuntu here as windows had an outage around this time that is too wide to pin down the root cause -- but both platforms see similar impact).

The likely culprit is dotnet/coreclr#19429. These tests have fairly tight loops so are sensitive to small changes in the in-loop codegen. Will follow-up with some diffs shortly.

cc @CarolEidt

AndyAyersMS on 16 Jul 2019

🎉1

I've found another very similar regression:

https://github.com/dotnet/performance/blob/9aa77fc38d6e1e0cabede6b5de29c156989781dc/src/benchmarks/micro/corefx/System.Runtime/Perf.String.cs#L313-L331

--filter *IndexerCheckPathLength

| Method | Toolchain | Mean | Ratio |
|----------------------- |-------------- |---------:|------:|
| IndexerCheckPathLength | netcoreapp2.2 | 119.0 ns | 1.00 |
| IndexerCheckPathLength | netcoreapp3.0 | 155.2 ns | 1.31 |

I am not going to create a new issue for it since it's most probably the same problem

adamsitnik on 16 Jul 2019

Another similar regression:

--filter *SeekUnroll*

| Method | Toolchain | boxedIndex | Mean | Ratio |
|----------- |-------------- |----------- |-----------:|------:|
| SeekUnroll | netcoreapp2.2 | 1 | 794.6 ms | 1.00 |
| SeekUnroll | netcoreapp3.0 | 1 | 1,061.0 ms | 1.33 |
| | | | | |
| SeekUnroll | netcoreapp2.2 | 3 | 797.1 ms | 1.00 |
| SeekUnroll | netcoreapp3.0 | 3 | 1,080.2 ms | 1.36 |
| | | | | |
| SeekUnroll | netcoreapp2.2 | 11 | 1,193.5 ms | 1.00 |
| SeekUnroll | netcoreapp3.0 | 11 | 1,398.3 ms | 1.17 |
| | | | | |
| SeekUnroll | netcoreapp2.2 | 19 | 1,455.7 ms | 1.00 |
| SeekUnroll | netcoreapp3.0 | 19 | 1,595.3 ms | 1.10 |
| | | | | |
| SeekUnroll | netcoreapp2.2 | 27 | 1,791.4 ms | 1.00 |
| SeekUnroll | netcoreapp3.0 | 27 | 2,122.3 ms | 1.18 |

adamsitnik on 16 Jul 2019

Seek unroll seems to be "bi-stable": via xunit-perf:

Via BDN we also see two stable levels

So perhaps no regression?

AndyAyersMS on 16 Jul 2019

👍1

For TestIndexer1 the 2.2 codegen is:

;; 2.2 TestIndexer1

G_M36437_IG01:

G_M36437_IG02:
       488B01               mov      rax, bword ptr [rcx]
       8B5108               mov      edx, dword ptr [rcx+8]
       33C9                 xor      ecx, ecx
       4533C0               xor      r8d, r8d
       85D2                 test     edx, edx
       7E17                 jle      SHORT G_M36437_IG04

G_M36437_IG03:
       4D63C8               movsxd   r9, r8d
       460FB60C08           movzx    r9, byte  ptr [rax+r9]
       4433C9               xor      r9d, ecx
       410FB6C9             movzx    rcx, r9b
       41FFC0               inc      r8d
       443BC2               cmp      r8d, edx
       7CE9                 jl       SHORT G_M36437_IG03

G_M36437_IG04:
       8BC1                 mov      eax, ecx

G_M36437_IG05:
       C3                   ret

and for 3.0:

;; 3.0 TestIndexer1

G_M36437_IG01:
       0F1F440000           nop      

G_M36437_IG02:
       488B01               mov      rax, bword ptr [rcx]
       8B5108               mov      edx, dword ptr [rcx+8]
       33C9                 xor      ecx, ecx
       4533C0               xor      r8d, r8d
       85D2                 test     edx, edx
       7E16                 jle      SHORT G_M36437_IG04

G_M36437_IG03:
       4D63C8               movsxd   r9, r8d
       460FB60C08           movzx    r9, byte  ptr [rax+r9]
       4133C9               xor      ecx, r9d
       0FB6C9               movzx    rcx, cl
       41FFC0               inc      r8d
       443BC2               cmp      r8d, edx
       7CEA                 jl       SHORT G_M36437_IG03

G_M36437_IG04:
       8BC1                 mov      eax, ecx

G_M36437_IG05:
       C3                   ret

The 3.0 loop body is one byte shorter and starts at a different offset because 3.0 includes a rejit nop pad at entry. So loop top alignment seems like a likely culprit to explain perf differences. But not sure this holds up. The method entry should be 16 byte aligned, and by my math that means the 2.2 loop body spans 3 cache lines and the 3.0 version only spans two. So I don't see any obvious reason for 3.0 being slower. Will need to drill in with a low-level profiler.

AndyAyersMS on 17 Jul 2019

I can repro this on a variety of machines. The loop head offset doesn't seem to be a factor; best guess it is something about slightly different instruction sequence in the loop. Still trying to pin down what that is....

AndyAyersMS on 18 Jul 2019

CPI on new hw is really good (0.22 for 2.2, 0.29 for 3.0), so the perf delta is some small micro-architectural detail. I think we exceed the theoretical best 0.25 because of macro fusion of the cmp/jl.

On old enough HW there is no difference:

'BenchmarkDotNet=v0.11.3.1003-nightly, OS=Windows 10.0.18362
Intel Xeon CPU E5645 2.40GHz, 1 CPU, 6 logical and 6 physical cores
.NET Core SDK=3.0.100-preview8-013317
  [Host]     : .NET Core 2.2.6 (CoreCLR 4.6.27817.03, CoreFX 4.6.27818.02), 64bit RyuJIT
  Job-LZZMHT : .NET Core 2.2.6 (CoreCLR 4.6.27817.03, CoreFX 4.6.27818.02), 64bit RyuJIT
  Job-TYGJWX : .NET Core 3.0.0-preview8-27917-07 (CoreCLR 4.700.19.36603, CoreFX 4.700.19.36703), 64bit RyuJIT

Runtime=Core  IterationTime=250.0000 ms  MaxIterationCount=20
MinIterationCount=15  WarmupCount=1

|   Method |     Toolchain | length |      Mean |
|--------- |-------------- |------- |----------:|
| Indexer1 | netcoreapp2.2 |   1024 |  1.170 us |
| Indexer1 | netcoreapp3.0 |   1024 |  1.115 us |
|          |               |        |           |
| Indexer2 | netcoreapp2.2 |   1024 |  1.115 us |
| Indexer2 | netcoreapp3.0 |   1024 |  1.116 us |
|          |               |        |           |
| Indexer3 | netcoreapp2.2 |   1024 |  1.124 us |
| Indexer3 | netcoreapp3.0 |   1024 |  1.117 us |
|          |               |        |           |
| Indexer4 | netcoreapp2.2 |   1024 | 11.254 us |
| Indexer4 | netcoreapp3.0 |   1024 | 11.119 us |
|          |               |        |           |
| Indexer5 | netcoreapp2.2 |   1024 |  1.122 us |
| Indexer5 | netcoreapp3.0 |   1024 |  1.112 us |
|          |               |        |           |
| Indexer6 | netcoreapp2.2 |   1024 |  1.123 us |
| Indexer6 | netcoreapp3.0 |   1024 |  1.115 us |

The second movzx is not needed and may be a contributor to the perf impact. I will look into why the peephole added in dotnet/coreclr#22454 is not getting rid of this (edit: the peephole only applies for 32 bit sources, here we have an 8 bit source; would be tricky to deduce the upper 56 bits of RCX are always zero).

AndyAyersMS on 18 Jul 2019

The second movzx is not needed and may be a contributor to the perf impact. I will look into why the peephole added in dotnet/coreclr#22454 is not getting rid of this.

Not sure how 22454 is related to this as this is a byte zero extend. Anyway, the ideal code is probably xor cl, byte ptr [rax+r9] which is more difficult to produce (and even the fact that it's ideal would be difficult to prove).

mikedn on 18 Jul 2019

@mikedn yep, realized that.

Seems like the perf issue here could be "mov elimination" introduced in Ivy Bridge, which evidently can optimize 2.2's movzx rcx, r9b but not 3.0's movzx rcx, cl.

Intel docs on "Zero-Latency MOV Instructions" don't mention the restrictions on same-register movs but other sources do. That would also explain why older HW does not see a difference. Changing the data type to int, I don't see any perf differences even on newer machines.

Looks like this perf issue is just restricted to the way these benchmarks are coded to accumulate bytes, jit codegen for that particular case, and limitations on optimization of some sign extending moves in HW, and is not a reflection on Span perf. So I'm going to mark this as future.

Perhaps for reg-reg sign extension on x86/x64 we should anti-preference SRC and DST?

@CarolEidt is this feasible?

AndyAyersMS on 18 Jul 2019

👍1

Perhaps for reg-reg sign extension on x86/x64 we should anti-preference SRC and DST? is this feasible?

That's not something the register allocator is currently set up to do, though limited cases could possibly be handled by either

avoiding preferencing for movzx (not sure if this case was actually preferenced), or
adding anti-preferencing of a single-reg source (i.e. if the source was constrained to be cl, then the target could exclude that from its preferences)

CarolEidt on 18 Jul 2019

Anyway, the ideal code is probably xor cl, byte ptr [rax+r9] which is more difficult to produce (and even the fact that it's ideal would be difficult to prove).

Actually producing this byte xor should be pretty easy - detect that it has a byte indir operand, change the xor type to byte as well and contain the indir. What's difficult to remove is the subsequent movzx. But it seems a rather exotic case, considering that this optimization only works with xor and or. Though and could be done too if we detect that it is used by movzx.

mikedn on 19 Jul 2019

@AndyAyersMS in case you are interested we have run all the benchmarks for more OSes and hardware configurations. It looks like AMD is not affected and newer Intels are less affected:

/cc @tannergooding

Legend

Statistical Test threshold: 5%, the noise filter: 0.3 ns
Base is Median Base in ns
Diff is Median Diff in ns

Span.IndexerBench.KnownSizeCtor(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | ------:| ------:| ---------:| --------:| -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Slower | 398.24 | 517.31 | 0.77 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 400.01 | 535.09 | 0.75 | | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 615.50 | 820.70 | 0.75 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 577.29 | 845.66 | 0.68 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 466.16 | 633.82 | 0.74 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 467.71 | 606.87 | 0.77 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 389.39 | 511.89 | 0.76 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 630.56 | 633.13 | 1.00 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 356.37 | 518.44 | 0.69 | | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|

Span.IndexerBench.ReadOnlyIndexer2(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | ------:| ------:| ---------:| --------:| -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Slower | 398.60 | 521.36 | 0.76 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 401.34 | 541.02 | 0.74 | | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 603.52 | 824.07 | 0.73 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 599.26 | 856.29 | 0.70 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 466.89 | 609.11 | 0.77 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 468.24 | 608.90 | 0.77 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 503.68 | 513.55 | 0.98 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 572.90 | 613.56 | 0.93 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 354.29 | 519.75 | 0.68 | | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|

Span.IndexerBench.Indexer3(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | ------:| ------:| ---------:| --------:| -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Slower | 398.35 | 521.52 | 0.76 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 400.15 | 545.82 | 0.73 | | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 608.93 | 823.04 | 0.74 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 622.11 | 850.75 | 0.73 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 466.33 | 612.49 | 0.76 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 467.75 | 609.18 | 0.77 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 502.33 | 513.35 | 0.98 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 573.14 | 613.74 | 0.93 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 361.86 | 543.83 | 0.67 | | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|

Span.IndexerBench.Indexer2(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | ------:| ------:| ---------:| --------:| -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Slower | 398.91 | 522.09 | 0.76 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 401.10 | 539.98 | 0.74 | | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 615.45 | 828.66 | 0.74 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 602.65 | 850.12 | 0.71 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 466.98 | 611.69 | 0.76 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 468.32 | 608.27 | 0.77 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 504.56 | 512.59 | 0.98 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 573.10 | 613.95 | 0.93 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 354.09 | 519.80 | 0.68 | | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|

Span.IndexerBench.Ref(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | ------:| ------:| ---------:| -------- | -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Slower | 399.19 | 521.49 | 0.77 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 419.01 | 535.09 | 0.78 | | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 625.04 | 837.85 | 0.75 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 608.25 | 852.45 | 0.71 | several? | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 467.22 | 615.19 | 0.76 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 467.13 | 607.31 | 0.77 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 505.50 | 515.87 | 0.98 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 573.74 | 629.88 | 0.91 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 347.24 | 519.61 | 0.67 | | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|

Span.IndexerBench.KnownSizeArray(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | ------:| ------:| ---------:| -------- | -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Slower | 398.81 | 521.80 | 0.76 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 415.71 | 542.60 | 0.77 | bimodal | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 618.45 | 830.41 | 0.74 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 616.57 | 853.14 | 0.72 | bimodal | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 466.67 | 609.96 | 0.77 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 467.38 | 609.53 | 0.77 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 503.60 | 512.49 | 0.98 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 572.36 | 613.80 | 0.93 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 354.24 | 520.18 | 0.68 | | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|

Span.IndexerBench.Indexer1(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | ------:| ------:| ---------:| --------:| -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Slower | 398.97 | 521.87 | 0.76 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 400.64 | 539.44 | 0.74 | | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 602.35 | 828.72 | 0.73 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 589.19 | 859.12 | 0.69 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 466.83 | 612.29 | 0.76 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 467.46 | 608.55 | 0.77 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 501.33 | 511.54 | 0.98 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 572.90 | 613.57 | 0.93 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 428.42 | 525.23 | 0.82 | | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|

Span.IndexerBench.Indexer4(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | -------:| -------:| ---------:| --------:| -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Slower | 3972.34 | 5188.56 | 0.77 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 3996.93 | 5433.27 | 0.74 | | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 6131.97 | 8279.67 | 0.74 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 6151.58 | 8454.14 | 0.73 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 4647.49 | 6054.22 | 0.77 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 4665.63 | 6055.60 | 0.77 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 3804.46 | 5062.46 | 0.75 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Faster | 6174.15 | 5687.63 | 1.09 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 4636.43 | 5428.14 | 0.85 | | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|

Span.IndexerBench.Fixed1(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | ------:| ------:| ---------:| --------:| -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Slower | 420.13 | 521.20 | 0.81 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 400.80 | 533.08 | 0.75 | | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 642.95 | 823.73 | 0.78 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 639.33 | 847.92 | 0.75 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 491.45 | 611.75 | 0.80 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 468.35 | 608.89 | 0.77 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 381.31 | 510.91 | 0.75 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Faster | 623.19 | 569.85 | 1.09 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 365.03 | 520.36 | 0.70 | | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|

Span.IndexerBench.Fixed2(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | ------:| ------:| ---------:| --------:| -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Slower | 420.51 | 521.18 | 0.81 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 402.37 | 538.17 | 0.75 | | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 639.55 | 828.50 | 0.77 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 677.64 | 846.10 | 0.80 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 491.73 | 612.01 | 0.80 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 468.36 | 610.51 | 0.77 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 380.45 | 510.97 | 0.74 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Faster | 623.16 | 570.02 | 1.09 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 353.62 | 520.61 | 0.68 | | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|

Span.IndexerBench.ReadOnlyIndexer1(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | ------:| ------:| ---------:| -------- | -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Slower | 398.95 | 520.83 | 0.77 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 419.13 | 546.08 | 0.77 | several? | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 609.47 | 827.16 | 0.74 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 600.26 | 852.35 | 0.70 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 467.02 | 608.92 | 0.77 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 467.26 | 608.47 | 0.77 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 503.19 | 513.62 | 0.98 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 572.38 | 613.86 | 0.93 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 423.68 | 520.98 | 0.81 | bimodal | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|

Span.IndexerBench.KnownSizeCtor2(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | ------:| ------:| ---------:| -------- | -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Slower | 408.16 | 485.92 | 0.84 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 418.60 | 481.79 | 0.87 | bimodal | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 634.84 | 772.33 | 0.82 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 610.34 | 758.47 | 0.80 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 478.02 | 540.33 | 0.88 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 478.21 | 541.53 | 0.88 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 507.32 | 513.82 | 0.99 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 618.65 | 609.41 | 1.02 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 359.62 | 436.63 | 0.82 | | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|

Span.IndexerBench.SameIndex1(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | -------:| -------:| ---------:| -------- | -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Same | 657.81 | 659.89 | 1.00 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 661.20 | 773.44 | 0.85 | | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 1026.46 | 1046.39 | 0.98 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 957.95 | 1077.67 | 0.89 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Same | 769.67 | 771.83 | 1.00 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 770.23 | 872.50 | 0.88 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 624.48 | 710.11 | 0.88 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 690.25 | 694.49 | 0.99 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 701.73 | 1304.76 | 0.54 | bimodal | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|

Span.IndexerBench.Indexer5(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | ------:| ------:| ---------:| --------:| -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Slower | 468.31 | 525.20 | 0.89 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 469.55 | 536.04 | 0.88 | | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 726.27 | 831.06 | 0.87 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 698.31 | 853.37 | 0.82 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 548.91 | 636.59 | 0.86 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 548.80 | 611.24 | 0.90 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 523.78 | 511.01 | 1.02 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 641.20 | 634.45 | 1.01 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 461.45 | 522.35 | 0.88 | | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|

Span.IndexerBench.CoveredIndex2(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | -------:| -------:| ---------:| -------- | -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Same | 788.04 | 787.27 | 1.00 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 825.55 | 820.79 | 1.01 | | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 1211.44 | 1243.19 | 0.97 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 1147.60 | 1278.93 | 0.90 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Same | 920.77 | 920.90 | 1.00 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 921.72 | 925.10 | 1.00 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 694.50 | 742.79 | 0.93 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 829.12 | 845.88 | 0.98 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 971.68 | 1307.68 | 0.74 | several? | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|

Span.IndexerBench.CoveredIndex1(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | -------:| -------:| ---------:| --------:| -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Same | 923.26 | 924.73 | 1.00 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 932.80 | 958.87 | 0.97 | | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 1459.93 | 1461.07 | 1.00 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 1359.89 | 1534.14 | 0.89 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Same | 1081.03 | 1081.87 | 1.00 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 1092.06 | 1091.26 | 1.00 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 864.12 | 877.16 | 0.99 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 1076.79 | 1077.75 | 1.00 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 1075.66 | 1310.84 | 0.82 | | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|

Span.IndexerBench.CoveredIndex3(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | -------:| -------:| ---------:| --------:| -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Same | 1045.62 | 1044.12 | 1.00 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 1097.08 | 1090.55 | 1.01 | | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 1671.09 | 1669.45 | 1.00 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 1546.95 | 1703.10 | 0.91 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Same | 1222.73 | 1222.78 | 1.00 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 1223.02 | 1227.78 | 1.00 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 947.79 | 959.48 | 0.99 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 973.04 | 971.47 | 1.00 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Slower | 1568.51 | 1817.35 | 0.86 | | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|

Span.IndexerBench.Indexer6(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | ------:| ------:| ---------:| --------:| -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Same | 524.49 | 525.30 | 1.00 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 524.74 | 550.83 | 0.95 | | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 820.63 | 847.23 | 0.97 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 761.34 | 859.80 | 0.89 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Same | 612.82 | 617.78 | 0.99 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 612.32 | 614.26 | 1.00 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 503.50 | 511.92 | 0.98 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 590.17 | 579.93 | 1.02 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 547.29 | 529.78 | 1.03 | | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|

Span.IndexerBench.WriteViaIndexer2(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | ------:| ------:| ---------:| -------- | -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Same | 558.46 | 556.47 | 1.00 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 557.77 | 574.42 | 0.97 | | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 888.84 | 898.23 | 0.99 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 867.14 | 923.61 | 0.94 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Same | 652.82 | 658.22 | 0.99 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 651.38 | 651.99 | 1.00 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 534.85 | 543.10 | 0.98 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 719.30 | 720.51 | 1.00 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 569.83 | 592.66 | 0.96 | bimodal | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|

Span.IndexerBench.SameIndex2(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | -------:| -------:| ---------:| --------:| -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Same | 781.74 | 783.14 | 1.00 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 805.61 | 803.76 | 1.00 | | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 1186.70 | 1238.72 | 0.96 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Slower | 1129.68 | 1281.30 | 0.88 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Same | 914.39 | 917.36 | 1.00 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 917.81 | 917.99 | 1.00 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 690.57 | 708.05 | 0.98 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 864.34 | 868.16 | 1.00 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 1375.74 | 1318.25 | 1.04 | | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|

Span.IndexerBench.WriteViaIndexer1(length: 1024)

| conclusion | Base | Diff | Base/Diff | Modality | Operating System | Arch | Processor Name | Base Runtime | Diff Runtime |
| ---------- | -------:| -------:| ---------:| --------:| -------------------- | ----- | ------------------------------------------- | --------------- | --------------------------------- |
| Same | 1531.16 | 1528.97 | 1.00 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 1538.66 | 1572.06 | 0.98 | | Windows 10.0.18362 | 64bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 2380.71 | 2435.27 | 0.98 | | ubuntu 16.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Same | 2343.10 | 2497.86 | 0.94 | | ubuntu 18.04 | 64bit | Intel Xeon CPU E5-2673 v4 2.30GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-01|
| Same | 1789.46 | 1806.14 | 0.99 | | macOS Mojave 10.14.5 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 1791.95 | 1791.49 | 1.00 | | Windows 10.0.18362 | 64bit | Intel Core i7-5557U CPU 3.10GHz (Broadwell) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 1344.73 | 1391.71 | 0.97 | | Windows 10.0.18362 | 64bit | Intel Core i7-7700 CPU 3.60GHz (Kaby Lake) | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 1915.16 | 1914.12 | 1.00 | | Windows 10.0.18362 | 64bit | AMD Ryzen 7 1800X | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|
| Same | 1605.37 | 1531.14 | 1.05 | | Windows 10.0.18362 | 32bit | Intel Xeon CPU E5-1650 v4 3.60GHz | .NET Core 2.2.6 | .NET Core 3.0.0-preview8-27919-09|