Azure-devops-docs: How to enable Flaky Test Management

[LyndseyPaxton]

Interesting article and something which I am keen to implement as we currently have several flaky tests. However, in all of my VSTS projects settings, I do not see an option for Project Settings -> Pipelines -> Test Management.

Is this something which needs to be manually enabled?

---

Document Details

⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

• ID: a8dfb3bf-8cce-7ad8-b2c6-40d6c2b9d441
• Version Independent ID: 53e2d39d-6808-70d5-9c26-bc4c5bb109e3
• Content: Flaky test management - Azure Pipelines
• Content Source: docs/pipelines/test/flaky-test-management.md
• Product: devops
• Technology: devops-cicd
• GitHub Login: @KathrynEE
• Microsoft Alias: kaelli

[ahaleiii]

This is a new feature so my guess is that they are still rolling it out across organizations.

https://docs.microsoft.com/en-us/azure/devops/release-notes/2019/sprint-155-update#in-product-support-for-flaky-test-management

I'm also excited for this because our team suffers from flaky tests (we've been calling them "non-determinate" tests).

[gregpakes]

I am waiting for this too. However, this update is from July 22. It is now Aug 6. Does the roll out take this long?

[KathrynEE]

@LyndseyPaxton, @ahaleiii , @gregpakes - The rollout was complete on July 31st. I've reached out to the PM who authored this article for more information. Will update you as soon as I get a response.

[divais]

We hit some deployment blocker and thus isn't not enabled. Hoping to complete the rollout in next 2-3 days. Sorry for the delay.

[divais]

Sorry reopening the issue, I closed it in err. I will close it when the deployment is complete for all customers.

[LyndseyPaxton]

Hi @divais,

Any update on the deployment?
Thanks

[iansul]

Ping. I thought I saw the settings light up in my account at some point, but they aren't there now. Any updates?

[divais]

Flaky feature is not enabled on all accounts. Do reach us if you face any issues.

[gregpakes]

Why closed?

[divais]

I closed it as the key concern was feature unavailability. Are you seeing issues? Do you prefer reopening?

[divais]

@gregpakes deleted your comment in err, was trying to remove the emoji. Is it possible to share your account name.

[gregpakes]

publicly? privately?

[divais]

can you please send the details to devops_tools @ microsoft.com

[gregpakes]

Done

[divais]

I did receive your email and responded back. Based on your system we see that flaky feature is enabled for your account.

[LyndseyPaxton]

Hi @divais

I just checked one of my projects in Azure DevOps, and the menu item is still not there.

Are you able to check if it is enabled for my account please?

Thanks
LP

[LyndseyPaxton]

Okay, I do see it in

Project Settings -> Test management

Thanks for your help. Feel free to close the ticket.

Cheers
LP

[gregpakes]

All looks good.

[divais]

Flaky settings are available in Project setting under Test management. Sample below with default settings.

[zhongyi-zhang]

Hi @divais, I sent an email to [email protected]. Could you help enable Flaky Test Management for us? Thanks

[upadhyayap]

@zhongyi-zhang It is now enabled. could you please try and let us know.