Cockroach: release: v19.2.6

[otan]

Candidate SHA: ee759892738f7f203ff95ec7627b90d7c47b4350
Deployment status:
http://yevgeniy-release-v1925-4f36d0c6-0001.roachprod.crdb.io:26258/#/overview/list
http://yevgeniy-release-v1926-ee759892-0001.roachprod.crdb.io:26258/#/overview/list
Nightly Suite:
https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_NightlySuite/1856158?mode=branches
Release process checklist

Prep date: WIP fill in date to roll out: usually Monday, a week before the release WIP

• [x] [Pick a SHA](https://cockroachlabs.atlassian.net/wiki/spaces/ENG/pages/73105625/Release+process#Releaseprocess-PickingaSHA)
  
  
  
  • [x] fill in Candidate SHA above
  
  
  • [x] notify #release-announce
  
  
  • [x] email thread on releases@
  
  
• [x] [Tag the provisional SHA](https://cockroachlabs.atlassian.net/wiki/spaces/ENG/pages/73105625/Release+process#Releaseprocess-TagtheprovisionalSHA)
• [x] [Publish provisional binaries](https://cockroachlabs.atlassian.net/wiki/spaces/ENG/pages/73105625/Release+process#Releaseprocess-Publishtheprovisionalbinaries)
• [x] Ack security@ on the generated Stackdriver Alert to confirm these writes were part of a planned release

Release Qualification

• [x] [Check binaries](https://cockroachlabs.atlassian.net/wiki/spaces/ENG/pages/73105625/Release+process#Releaseprocess-Checkbinaries)
• [x] [Deploy to test clusters](https://cockroachlabs.atlassian.net/wiki/spaces/ENG/pages/73105625/Release+process#Releaseprocess-DeploytoTestClusters)
• [ ] [Verify node crash reports](https://cockroachlabs.atlassian.net/wiki/spaces/ENG/pages/73105625/Release+process#Releaseprocess-Verifynodecrashreportsappearinsentry.io)
• [x] [Start release qualification suite](https://cockroachlabs.atlassian.net/wiki/spaces/ENG/pages/73105625/Release+process#Releaseprocess-RuntheSuiteofNightlyRoachtests)
• [x] [Start nightly suite](https://cockroachlabs.atlassian.net/wiki/spaces/ENG/pages/73105625/Release+process#Releaseprocess-RuntheSuiteofNightlyRoachtests)
• [x] fill in Deployment status above with clusters and Nightly Suite with the link to Nightly TeamCity Job

One day after prep date:

• [x] [Get signoff on roachtest failures](https://cockroachlabs.atlassian.net/wiki/spaces/ENG/pages/73105625/Release+process#Releaseprocess-RoachtestFailureSignoff)

• [x] [Keep an eye on clusters](https://cockroachlabs.atlassian.net/wiki/spaces/ENG/pages/328859690/Release+Qualification#Monitoring-the-Qualification-Clusters) until release date. Do not proceed below until the release date.

Release date: WIP fill in date: usually Monday WIP

• [x] [Check cluster status](https://cockroachlabs.atlassian.net/wiki/spaces/ENG/pages/328859690/Release+Qualification#Monitoring-the-Qualification-Clusters)
• [x] [Tag release](https://cockroachlabs.atlassian.net/wiki/spaces/ENG/pages/73105625/Release+process#Releaseprocess-Tagtherelease)
• [x] [Bless provisional binaries](https://cockroachlabs.atlassian.net/wiki/spaces/ENG/pages/73105625/Release+process#Releaseprocess-Blesstheprovisionalbinaries)

• For production or stable releases in the latest major release series

  • [x] Update the Homebrew Formula (PR)
  • [x] Update the image tag in our Orchestrator configurations (PR)
  • [ ] Update the image tag in Helm's Orchestrator configurations (PR)
  • [x] Announce version to the registration cluster

• [x] Update docs

• [ ] External communications for release
• [x] Clean up provisional tag from repository

[otan]

blocked on https://github.com/cockroachdb/cockroach/pull/46947, unless I can get the SHA that needs to be in there and it's not red. cc @kscurtis

[rohany]

Can you also wait on https://github.com/cockroachdb/cockroach/pull/46950, there is a customer blocked on this.

[otan]

yas

[knz]

This probably needs to get in too: #46904

[knz]

And this: #46479

[otan]

@rohany @knz can you try get this in before Monday? CC is okay holding off as long as it's well before EOM, but would like this to be properly aligned with Monday next week so we can release the following Monday (cc @kscurtis).

[rohany]

Can you also wait on #46950, there is a customer blocked on this.

done

[knz]

And this: #46479

done.

Waiting on @andreimatei / @ajwerner for #46904

[ajwerner]

46904 is done

[miretskiy]

I'm seeing increase in sql 99th percentile latencies. Waiting for sql team to have a look.
http://yevgeniy-release-v1925-4f36d0c6-0001.roachprod.crdb.io:26258/#/metrics/sql/cluster vs http://yevgeniy-release-v1926-ee759892-0001.roachprod.crdb.io:26258/#/metrics/sql/cluster

[miretskiy]

Going to tear down and restart test clusters. There is some hardware performance differences between 19.2.5 and 19.2.6 clusters

[jseldess]

Release notes are live: https://www.cockroachlabs.com/docs/releases/v19.2.6.html

[nathanstilwell]

This release is out, but still dealing with failures in Helm orchestration PR