Update: Azure ML is quite a wonderful technology; however like all statistical approaches, it's only as powerful as the data fed into it. Setting it up and evaluating various classification models went well. The problem is that training the models with the existing code block data is insufficient for producing any decent predictive model that we can use.
I'm going to Plan B.
is this done @GuardRex?
@mairaw 馃槄 Not yet ..... I have more work to do here. I'll get back to this asap. I ended up needing to address each type of code block (by lang ident) with separate scripts, and I still have several lang idents to go here.
@GuardRex is this one completely done?
It's not done. There are several that I didn't reach before getting into other higher priority issues. JSON, XML, PowerShell are the only ones I was able to address thus far. The complete list goes something like this ...
[This is from my (failed :cry:) attempt to (quickly) use Azure ML to solve it. I couldn't make a strong enough model from the docs data to pull it off (although there are other approaches to build a useful model for Azure ML that I didn't have time to explore).]
var referenceLangIdents = new List<string>()
{
"csharp", "fsharp", "vb", "xml", "console", "html", "javascript", "json",
"xaml", "powershell", "azurecli", "azcopy", "cpp", "nodejs", "objc",
"php", "python", "ruby", "sql", "swift"
};
Therefore, there are many code blocks across the repo that match these that I didn't have time to fix outside of xml, json, and powershell.
@mairaw Another one that there's no way for me to finish by 7/31. I started the ball rolling, but there's an unknown large number of code blocks without lang idents on them that require attention down the road. Do u want to re-assign?
I took a bit time of time this evening to add missing language identifiers to code blocks located in docs/csharp/misc (C# compiler errors). Result : 666 files modified 馃槇 . That would be a very, very large PR... How many PR would you get for this ?
@sputier How about do them in blocks of 50. Since the changes are straightforward, they should be quick to review.
This is awesome! I can run our QA tool again after these batches are done and published to identify how many topics still have the issue throughout the repo (some are by design though).
As always, I'll be glad to help adding these identifiers wherever I can :-)
If you get any result from the QA tool which could help me finding the relevant spots in the docs, they are welcome !
We really appreciate the help @sputier!
@BillWagner is the work here is done or there is something left?
Here is a list of the current missing identifiers (Keeping in mind that some (or maybe all) should remain):
D:\dotnet\docs\docs\docs\architecture\cloud-native\logging-with-elastic-stack.md
Line 49: ```
Line 79: ```
D:\dotnet\docs\docs\docs\architecture\grpc-for-wcf-developers\migrate-request-reply.md
Line 205: ```
D:\dotnet\docs\docs\docs\core\deploying\runtime-store.md
Line 12: ```
D:\dotnet\docs\docs\docs\core\distribution-packaging.md
Line 18: ```
D:\dotnet\docs\docs\docs\core\docker\build-container.md
Line 47: ```
Line 72: > ```
Line 191: ```
D:\dotnet\docs\docs\docs\core\porting\winforms.md
Line 62: ```
Line 92: ```
Line 190: ```
D:\dotnet\docs\docs\docs\core\rid-catalog.md
Line 53: ```
D:\dotnet\docs\docs\docs\core\testing\unit-testing-fsharp-with-dotnet-test.md
Line 21: ```
Line 40: ```
Line 69: ```
D:\dotnet\docs\docs\docs\core\testing\unit-testing-fsharp-with-mstest.md
Line 21: ```
Line 69: ```
D:\dotnet\docs\docs\docs\core\testing\unit-testing-fsharp-with-nunit.md
Line 31: ```
Line 60: ```
Line 95: ```
D:\dotnet\docs\docs\docs\core\testing\unit-testing-visual-basic-with-dotnet-test.md
Line 16: ```
D:\dotnet\docs\docs\docs\core\testing\unit-testing-with-dotnet-test.md
Line 16: ```
D:\dotnet\docs\docs\docs\core\tutorials\debugging-with-visual-studio-code.md
Line 48: ```
Line 54: ```
D:\dotnet\docs\docs\docs\core\tutorials\libraries.md
Line 201: ```
D:\dotnet\docs\docs\docs\core\tutorials\library-with-visual-studio-code.md
Line 39: ```
Line 55: ```
Line 72: ```
Line 106: ```
Line 131: ```
Line 148: ```
Line 174: ```
Line 190: ```
D:\dotnet\docs\docs\docs\core\tutorials\publishing-with-visual-studio-code.md
Line 36: ```
D:\dotnet\docs\docs\docs\core\tutorials\publishing-with-visual-studio-mac.md
Line 66: ```
D:\dotnet\docs\docs\docs\core\tutorials\publishing-with-visual-studio.md
Line 84: ```
D:\dotnet\docs\docs\docs\core\tutorials\testing-library-with-visual-studio-code.md
Line 109: ```
Line 139: ```
D:\dotnet\docs\docs\docs\core\tutorials\testing-with-cli.md
Line 16: ```
Line 28: ```
Line 49: ```
Line 163: ```
D:\dotnet\docs\docs\docs\core\versions\index.md
Line 41: ```
D:\dotnet\docs\docs\docs\framework\configure-apps\file-schema\wcf\add-of-baseaddressprefixfilter.md
Line 52: ```
D:\dotnet\docs\docs\docs\framework\configure-apps\file-schema\wcf\baseaddressprefixfilters.md
Line 54: ```
D:\dotnet\docs\docs\docs\framework\wcf\feature-details\how-to-register-and-configure-a-service-moniker.md
Line 53: ```
Line 59: ```
D:\dotnet\docs\docs\docs\framework\wcf\feature-details\how-to-replace-the-wcf-url-reservation-with-a-restricted-reservation.md
Line 14: ```
D:\dotnet\docs\docs\docs\framework\wcf\feature-details\messaging-protocols.md
Line 334: ```
Line 361: ```
Line 414: ```
Line 459: ```
Line 470: ```
Line 476: ```
Line 482: ```
Line 495: ```
Line 501: ```
Line 511: ```
Line 517: ```
Line 534: ```
Line 541: ```
Line 577: ```
Line 611: ```
D:\dotnet\docs\docs\docs\framework\wcf\feature-details\troubleshooting-correlation.md
Line 199: ```
Line 205: ```
D:\dotnet\docs\docs\docs\framework\wcf\feature-details\use-the-wcf-service-moniker-without-registration.md
Line 42: ```
D:\dotnet\docs\docs\docs\framework\wcf\feature-details\workflow-services-overview.md
Line 57: ```
D:\dotnet\docs\docs\docs\framework\windows-workflow-foundation\how-to-update-the-definition-of-a-running-workflow-instance.md
Line 1482: ```
Line 1490: ```
D:\dotnet\docs\docs\docs\framework\wpf\advanced\globalization-for-wpf.md
Line 22: ```
Line 28: ```
D:\dotnet\docs\docs\docs\fsharp\style-guide\conventions.md
Line 355: ```
D:\dotnet\docs\docs\docs\spark\how-to-guides\databricks-deploy-methods.md
Line 21: ```
Line 44: ```
D:\dotnet\docs\docs\docs\spark\how-to-guides\ubuntu-instructions.md
Line 67: ```
D:\dotnet\docs\docs\docs\spark\how-to-guides\windows-instructions.md
Line 51: ```
D:\dotnet\docs\docs\docs\spark\tutorials\databricks-deployment.md
Line 182: ```
D:\dotnet\docs\docs\docs\standard\analyzers\portability-analyzer.md
Line 36: ```
D:\dotnet\docs\docs\docs\standard\assembly\enhanced-strong-naming.md
Line 110: ```
D:\dotnet\docs\docs\docs\standard\assembly\names.md
Line 15: ```
Line 28: ```
D:\dotnet\docs\docs\docs\standard\base-types\character-encoding-introduction.md
Line 83: ```
Line 136: ```
Line 144: ```
Line 154: ```
Line 163: ```
Line 292: ```
D:\dotnet\docs\docs\docs\standard\globalization-localization\globalization-icu.md
Line 147: ```
D:\dotnet\docs\docs\docs\standard\serialization\system-text-json-converters-how-to.md
Line 89: ```
D:\dotnet\docs\docs\docs\standard\serialization\system-text-json-migrate-from-newtonsoft-how-to.md
Line 141: ```
Line 168: ```
D:\dotnet\docs\docs\docs\visual-basic\programming-guide\concepts\linq\how-to-project-an-anonymous-type.md
Line 11: ```
D:\dotnet\docs\docs\includes\core-changes\aspnetcore\3.0\mvc-jsonresult-moved.md
Line 17: ```
D:\dotnet\docs\docs\includes\core-changes\aspnetcore\5.0\http-httpclient-instances-log-integer-status-codes.md
Line 13: ```
Line 22: ```
D:\dotnet\docs\docs\samples\snippets\core\testing\unit-testing-using-dotnet-test\csharp\README.md
Line 13: ```
D:\dotnet\docs\docs\samples\snippets\core\testing\unit-testing-using-mstest\csharp\README.md
Line 13: ```
D:\dotnet\docs\docs\samples\snippets\core\testing\unit-testing-using-nunit\csharp\README.md
Line 13: ```
D:\dotnet\docs\docs\samples\snippets\core\tutorials\netcore-hosting\csharp\HostWithHostFxr\readme.md
Line 43: ```
D:\dotnet\docs\docs\samples\snippets\csharp\classes-quickstart\README.md
Line 15: ```
D:\dotnet\docs\docs\samples\snippets\csharp\delegates-and-events\README.md
Line 17: ```
D:\dotnet\docs\docs\samples\snippets\csharp\events\README.md
Line 16: ```
D:\dotnet\docs\docs\samples\snippets\csharp\getting-started\console-linq\README.md
Line 13: ```
D:\dotnet\docs\docs\samples\snippets\csharp\getting-started\console-webapiclient\README.md
Line 16: ```
D:\dotnet\docs\docs\samples\snippets\csharp\versioning\new\README.md
Line 16: ```
D:\dotnet\docs\docs\samples\snippets\csharp\versioning\override\README.md
Line 16: ```
After those are reviewed, I think the issue can be closed.
Note: I've removed what is done within #19318 and #19319 from the above list.