When running tests on Lighthouse and PageSpeed Insight, we spotted some inconsistencies in the speed index classification of what is a 'fast', i.e. green/orange/red:
speed index of 3.2s is green
speed index of 1.6s is orange
Both results are observed in Desktop mode.
Since speed index is a Lab Data field, I expected the 2 tools to give the same classification.
Thanks for filing @RustedBones! The score scale for desktop in Page Speed Insights is adjusted for the faster connection type, but the score scale is not automatically adjusted in other Lighthouse environments.
We would like to fix this discrepancy in other environments but doing so while supporting all the other available flags in an intuitive way is challenging.
It looks like you were running in DevTools though which should be the most straightforward. @connorjclark do you think this is something we could tackle with an upcoming roll? (Using the desktop config when the "Desktop" radio is selected instead of just setting emulatedFormFactor?)
If my understanding is right, you are meaning that PageSpeed Insights is using the lighthouse-core/config/lr-desktop-config.js with
// 75th and 95th percentiles -> median and PODR
// SELECT QUANTILES(SpeedIndex, 21) FROM [httparchive:summary_pages.2018_12_15_desktop] LIMIT 1000
{path: 'metrics/speed-index', options: {scorePODR: 1100, scoreMedian: 2300}},
that changes the underlying score from page speed hence its color, but Lighthouse doesn't.
Lighthouse then scores the metrics the same way for desktop and mobile with the default values.
Is this correct ?
Yes exactly correct @RustedBones !
Updated title. Our planned action is to use the lr-desktop-config.js score configuration everywhere (dt, cli, etc) when desktop mode is set.
Most helpful comment
Updated title. Our planned action is to use the
lr-desktop-config.jsscore configuration everywhere (dt, cli, etc) when desktop mode is set.