Azure-pipelines-tasks: Visual Studio Test not using Proxy setting for uploading .TRX file

[Shortcheese]

Required Information

Entering this information will route you directly to the right team and expedite traction.

Question, Bug, or Feature?
Type: Bug

Enter Task Name: VsTestV2

Environment

• Server - Azure Pipelines
• Agent - Private:
  
  
  
  • Current agent version: '2.155.1'
  
  
  • Run as Interactive agent
  
  
  • Windows 10 (1803)
  
  
  • Configured to run behind corparate proxy conform Instructions
  
  

Issue Description

We using Azure devops with on premise hosted build agents. Running on a Windows 10 envrioment for testing our software. Using the VS test task to test our code using specflow and nUnit.

The tests are running correctly, but when the task should return the .trx file(s) we get a warning that the file cannot be uploaded. In pipeline tab "Test" We see the testresults

We see in our corporate proxy that there is no rule to block this communication. But we see that the specific communication from the buildagent for this task, for the uploading of the *.trx file is bypassing the proxy. even when a system proxy and proxy settings on the agent are set.

The corporate firewall log is showing the communication bypassing the proxy.
It feels a little bit the same as #11172 but with a different task.

Task logs

2019-09-05T08:00:24.1632700Z ##[section]Starting: VsTest - testAssemblies
2019-09-05T08:00:24.1988961Z ==============================================================================
2019-09-05T08:00:24.1989011Z Task         : Visual Studio Test
2019-09-05T08:00:24.1989054Z Description  : Run unit and functional tests (Selenium, Appium, Coded UI test, etc.) using the Visual Studio Test (VsTest) runner. Test frameworks that have a Visual Studio test adapter such as MsTest, xUnit, NUnit, Chutzpah (for JavaScript tests using QUnit, Mocha and Jasmine), etc. can be run. Tests can be distributed on multiple agents using this task (version 2).
2019-09-05T08:00:24.1989096Z Version      : 2.156.2
2019-09-05T08:00:24.1989120Z Author       : Microsoft Corporation
2019-09-05T08:00:24.1989161Z Help         : https://docs.microsoft.com/azure/devops/pipelines/tasks/test/vstest
2019-09-05T08:00:24.1989186Z ==============================================================================
2019-09-05T08:00:25.7695101Z SystemVssConnection exists true
2019-09-05T08:00:46.7983614Z ##[warning]Unable to get feature flag: TestExecution.EnableHydra
2019-09-05T08:00:46.7996625Z SystemVssConnection exists true
2019-09-05T08:01:07.8162760Z ##[warning]Unable to get feature flag: TestExecution.EnableTranslationApi
2019-09-05T08:01:07.8512004Z SystemVssConnection exists true
2019-09-05T08:01:28.8971392Z ##[warning]Unable to get feature flag: TestExecution.EnableDiagnostics
2019-09-05T08:01:28.9512002Z Running tests using vstest.console.exe runner.
2019-09-05T08:01:28.9512074Z ======================================================
2019-09-05T08:01:28.9518107Z Test selector : Test assemblies
2019-09-05T08:01:28.9534130Z Test filter criteria : null
2019-09-05T08:01:28.9535159Z Search folder : C:\TestAgents\<AgentName>\_work\2\a\SysteemIntegratieTest
2019-09-05T08:01:29.6531891Z Run settings file : C:\TestAgents\<AgentName>\_work\2\s\SysteemIntegratieTest\testSettings\SysteemintegratietestTest.runsettings
2019-09-05T08:01:29.6532162Z Run in parallel : false
2019-09-05T08:01:29.6532219Z Run in isolation : false
2019-09-05T08:01:29.6532277Z Path to custom adapters : null
2019-09-05T08:01:29.6532417Z Other console options : null
2019-09-05T08:01:29.6532470Z Code coverage enabled : false
2019-09-05T08:01:29.6532496Z Diagnostics enabled : false
2019-09-05T08:01:29.6532593Z Rerun failed tests: true
2019-09-05T08:01:29.6532661Z Rerun failed tests threshold: 100
2019-09-05T08:01:29.6532719Z Rerun maximum attempts: 2
2019-09-05T08:01:29.6532788Z SystemVssConnection exists true
2019-09-05T08:01:29.6533273Z Run the tests locally using vstest.console.exe
2019-09-05T08:01:29.6533317Z ========================================================
2019-09-05T08:01:29.6649021Z Source filter: **\<TestDLLName>,!**\*TestAdapter.dll,!**\obj\**
2019-09-05T08:01:29.7019588Z SystemVssConnection exists true
2019-09-05T08:01:31.0625639Z [command]C:\TestAgents\<AgentName>\_work\_tasks\VSTest_ef087383-ee5e-42c7-9a53-ab56c98420f9\2.156.2\Modules\DTAExecutionHost.exe --inputFile C:\TestAgents\<AgentName>\_work\_temp\input_5e2290d1-cfb3-11e9-8a42-eb99a2aa2428.json
2019-09-05T08:01:31.0719283Z ======================================================
2019-09-05T08:01:31.1852550Z ##########################################################################
2019-09-05T08:01:31.1870566Z DtaExecutionHost version 17.156.29214.2.
2019-09-05T08:01:31.5468558Z Starting TestExecution Model...
2019-09-05T08:01:33.2294115Z Provided settings file:
2019-09-05T08:01:33.2295038Z <?xml version="1.0" encoding="utf-8"?>  
2019-09-05T08:01:33.2295492Z <RunSettings>  
2019-09-05T08:01:33.2295717Z   <!-- Configurations that affect the Test Framework -->  
2019-09-05T08:01:33.2295876Z   <RunConfiguration>  
2019-09-05T08:01:33.2296033Z     <MaxCpuCount>1</MaxCpuCount>  
2019-09-05T08:01:33.2296201Z     <!-- Path relative to solution directory -->  
2019-09-05T08:01:33.2296355Z     <ResultsDirectory>.\TestResults</ResultsDirectory>  
2019-09-05T08:01:33.2298013Z   
2019-09-05T08:01:33.2298532Z     <!-- [x86] | x64    
2019-09-05T08:01:33.2298759Z       - You can also change it from menu Test, Test Settings, Default Processor Architecture -->  
2019-09-05T08:01:33.2298916Z     <TargetPlatform>x64</TargetPlatform>  
2019-09-05T08:01:33.2299089Z   </RunConfiguration>  
2019-09-05T08:01:33.2299241Z     
2019-09-05T08:01:33.2299933Z   <!-- Parameters used by tests at runtime -->  
2019-09-05T08:01:33.2300116Z   <TestRunParameters>
2019-09-05T08:01:33.2315095Z   </TestRunParameters>  
2019-09-05T08:01:33.2315246Z </RunSettings>
2019-09-05T08:01:33.2486096Z Updated Run Settings:
2019-09-05T08:01:33.2486906Z <RunSettings>
2019-09-05T08:01:33.2487162Z   <!-- Configurations that affect the Test Framework -->
2019-09-05T08:01:33.2487326Z   <RunConfiguration>
2019-09-05T08:01:33.2487483Z     <MaxCpuCount>1</MaxCpuCount>
2019-09-05T08:01:33.2487660Z     <!-- Path relative to solution directory -->
2019-09-05T08:01:33.2488070Z     <ResultsDirectory>C:\TestAgents\<AgentName>\_work\_temp\.\TestResults\TestResults</ResultsDirectory>
2019-09-05T08:01:33.2488256Z     <!-- [x86] | x64    
2019-09-05T08:01:33.2488417Z       - You can also change it from menu Test, Test Settings, Default Processor Architecture -->
2019-09-05T08:01:33.2488587Z     <TargetPlatform>x64</TargetPlatform>
2019-09-05T08:01:33.2488738Z     <BatchSize>1000</BatchSize>
2019-09-05T08:01:33.2489202Z   </RunConfiguration>
2019-09-05T08:01:33.2489453Z   <!-- Parameters used by tests at runtime -->
2019-09-05T08:01:33.2489606Z   
2019-09-05T08:01:33.2489760Z </RunSettings>
2019-09-05T08:01:33.2592291Z **************** Starting test execution *********************
2019-09-05T08:01:33.2782689Z [command]C:\TestAgents\<AgentName>\_work\_tool\VsTest\16.3.0-preview-20190828-03\x64\tools\net451\Common7\IDE\Extensions\TestPlatform\vstest.console.exe "@C:\Users\<SystemUserName>\AppData\Local\Temp\tmpB20B.tmp"
2019-09-05T08:01:33.4155773Z Microsoft (R) Test Execution Command Line Tool Version 16.3.0-preview-20190828-03
2019-09-05T08:01:33.4156587Z Copyright (c) Microsoft Corporation.  All rights reserved.
2019-09-05T08:01:33.4443953Z vstest.console.exe "C:\TestAgents\<AgentName>\_work\2\a\SysteemIntegratieTest\SysteemIntegratieTest\<TestDLLName>"
2019-09-05T08:01:33.4444488Z /Settings:"C:\TestAgents\<AgentName>\_work\_temp\vtja5oiq5kx.runsettings"
2019-09-05T08:01:33.4444754Z /Logger:"trx"
2019-09-05T08:01:33.4445077Z /TestAdapterPath:"C:\TestAgents\<AgentName>\_work\2\a\SysteemIntegratieTest"
2019-09-05T08:01:34.1696374Z Starting test execution, please wait...
2019-09-05T08:01:34.3881810Z A total of 1 test files matched the specified pattern.
2019-09-05T08:01:35.9110488Z NUnit Adapter 3.13.0.0: Test execution started
2019-09-05T08:01:35.9111357Z Running all tests in C:\TestAgents\<AgentName>\_work\2\a\SysteemIntegratieTest\SysteemIntegratieTest\<TestDLLName>
2019-09-05T08:01:36.5487480Z    NUnit3TestExecutor converted 12 of 12 NUnit test cases
<TestOutcome>
2019-09-05T08:01:44.5508688Z Results File: C:\TestAgents\<AgentName>\_work\_temp\.\TestResults\TestResults\<SystemUserName>_<SystemUserName>_2019-09-05_10_01_44.trx
2019-09-05T08:01:44.5540695Z Total tests: 12
2019-09-05T08:01:44.5541161Z      Failed: 12
2019-09-05T08:01:44.5542163Z ##[error]Test Run Failed.
2019-09-05T08:01:44.5545679Z  Total time: 10,1172 Seconds
2019-09-05T08:01:44.7572873Z Vstest.console.exe exited with code 1.
2019-09-05T08:01:44.7573351Z **************** Completed test execution *********************
2019-09-05T08:01:44.7631903Z Test results files: C:\TestAgents\<AgentName>\_work\_temp\TestResults\TestResults\<SystemUserName>_<SystemUserName>_2019-09-05_10_01_44.trx
2019-09-05T08:01:44.9836419Z Created test run: 1099724
2019-09-05T08:01:44.9837298Z Publishing test results: 12
2019-09-05T08:01:45.0526155Z Publishing test results to test run '1099724'.
2019-09-05T08:01:45.0562845Z TestResults To Publish 12, Test run id:1099724
2019-09-05T08:01:45.0659195Z Test results publishing 12, remaining: 0. Test run id: 1099724
2019-09-05T08:01:45.3473320Z Published test results: 12
2019-09-05T08:01:45.3479370Z Publishing Attachments: 1
2019-09-05T08:01:46.1811056Z ##[warning]Failed to upload file <SystemUserName>_<SystemUserName>_2019-09-05_10_01_44.trx to Blob Transfer exception with errorcode Unknown, exception message Microsoft.WindowsAzure.Storage.DataMovement.TransferException: The transfer failed. ---> Microsoft.WindowsAzure.Storage.StorageException: De externe server heeft een fout geretourneerd: (403) Niet toegestaan. ---> System.Net.WebException: De externe server heeft een fout geretourneerd: (403) Niet toegestaan.
2019-09-05T08:01:46.1812431Z    bij Microsoft.WindowsAzure.Storage.Shared.Protocol.HttpResponseParsers.ProcessExpectedStatusCodeNoException[T](HttpStatusCode expectedStatusCode, HttpStatusCode actualStatusCode, T retVal, StorageCommandBase`1 cmd, Exception ex)
2019-09-05T08:01:46.1813073Z    bij Microsoft.WindowsAzure.Storage.Blob.CloudBlob.<>c__DisplayClass22.<FetchAttributesImpl>b__21(RESTCommand`1 cmd, HttpWebResponse resp, Exception ex, OperationContext ctx)
2019-09-05T08:01:46.1813782Z    bij Microsoft.WindowsAzure.Storage.Core.Executor.Executor.EndGetResponse[T](IAsyncResult getResponseResult)
2019-09-05T08:01:46.1814348Z    --- Einde van intern uitzonderingsstackpad ---
2019-09-05T08:01:46.1814986Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.BlockBlobWriter.HandleFetchAttributesResult(Exception e)
2019-09-05T08:01:46.1815670Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.BlockBlobWriter.<FetchAttributesAsync>d__18.MoveNext()
2019-09-05T08:01:46.1816326Z --- Einde van stacktracering vanaf vorige locatie waar uitzondering is opgetreden ---
2019-09-05T08:01:46.1816962Z    bij System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2019-09-05T08:01:46.1817558Z    bij System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2019-09-05T08:01:46.1818110Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.BlockBlobWriter.<DoWorkInternalAsync>d__17.MoveNext()
2019-09-05T08:01:46.1818764Z --- Einde van stacktracering vanaf vorige locatie waar uitzondering is opgetreden ---
2019-09-05T08:01:46.1819314Z    bij System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2019-09-05T08:01:46.1820132Z    bij System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2019-09-05T08:01:46.1820760Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.SyncTransferController.<DoWorkInternalAsync>d__13.MoveNext()
2019-09-05T08:01:46.1821383Z --- Einde van stacktracering vanaf vorige locatie waar uitzondering is opgetreden ---
2019-09-05T08:01:46.1822013Z    bij System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2019-09-05T08:01:46.1822583Z    bij System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2019-09-05T08:01:46.1823207Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.TransferControllerBase.<DoWorkAsync>d__33.MoveNext()
2019-09-05T08:01:46.1823796Z --- Einde van stacktracering vanaf vorige locatie waar uitzondering is opgetreden ---
2019-09-05T08:01:46.1823990Z    bij System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2019-09-05T08:01:46.1824158Z    bij System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2019-09-05T08:01:46.1824333Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferScheduler.<ExecuteJobInternalAsync>d__22.MoveNext()
2019-09-05T08:01:46.1824500Z    --- Einde van intern uitzonderingsstackpad ---
2019-09-05T08:01:46.1824658Z    bij Microsoft.TeamFoundation.TestClient.PublishTestResults.TestLogStore.<_executeWithRetry>d__32.MoveNext()
2019-09-05T08:01:46.1824893Z --- Einde van stacktracering vanaf vorige locatie waar uitzondering is opgetreden ---
2019-09-05T08:01:46.1825065Z    bij System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2019-09-05T08:01:46.1825566Z    bij System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2019-09-05T08:01:46.1825725Z    bij Microsoft.TeamFoundation.TestClient.PublishTestResults.TestLogStore.<UploadInternalAsync>d__18.MoveNext()
2019-09-05T08:01:46.4701236Z Failed tests: 12; Total tests: 12;
2019-09-05T08:01:46.5517756Z Total failed tests as return by TCM:12 
2019-09-05T08:01:46.5518371Z Found 1 filtered test case sources.
2019-09-05T08:01:46.5576178Z **************** Rerunning failed tests for Test run 1099724 *********************
2019-09-05T08:01:46.5576633Z Max attempts: 2; Current attempt: 1; Failed test cases threshold: 100; Failed test cases max limit: 0
2019-09-05T08:01:46.5576792Z [command]C:\TestAgents\<AgentName>\_work\_tool\VsTest\16.3.0-preview-20190828-03\x64\tools\net451\Common7\IDE\Extensions\TestPlatform\vstest.console.exe "@C:\Users\<SystemUserName>\AppData\Local\Temp\tmpE5DE.tmp"
2019-09-05T08:01:46.6955806Z Microsoft (R) Test Execution Command Line Tool Version 16.3.0-preview-20190828-03
2019-09-05T08:01:46.6957378Z Copyright (c) Microsoft Corporation.  All rights reserved.
2019-09-05T08:01:46.7370220Z vstest.console.exe /TestCaseFilter:"FullyQualifiedName=<Filter>"
2019-09-05T08:01:46.7371599Z "C:\TestAgents\<AgentName>\_work\2\a\SysteemIntegratieTest\SysteemIntegratieTest\<TestDLLName>"
2019-09-05T08:01:46.7371903Z /Settings:"C:\TestAgents\<AgentName>\_work\_temp\vtja5oiq5kx.runsettings"
2019-09-05T08:01:46.7372061Z /Logger:"trx"
2019-09-05T08:01:46.7372205Z /TestAdapterPath:"C:\TestAgents\<AgentName>\_work\2\a\SysteemIntegratieTest"
2019-09-05T08:01:47.4604168Z Starting test execution, please wait...
2019-09-05T08:01:47.6809277Z A total of 1 test files matched the specified pattern.
2019-09-05T08:01:49.2763502Z NUnit Adapter 3.13.0.0: Test execution started
2019-09-05T08:01:49.2858311Z ##[error]An exception occurred while invoking executor 'executor://nunit3testexecutor/': Incorrect format for TestCaseFilter Error: Invalid Condition '<>'. Specify the correct format and try again. Note that the incorrect format can lead to no test getting executed.
2019-09-05T08:01:49.6340686Z Results File: C:\TestAgents\<AgentName>\_work\_temp\.\TestResults\TestResults\<SystemUserName>_<SystemUserName>_2019-09-05_10_01_49.trx
2019-09-05T08:01:49.6357077Z ##[error]Test Run Failed.
2019-09-05T08:01:49.6969079Z Vstest.console.exe exited with code 1.
2019-09-05T08:01:49.6970057Z **************** Completed test execution *********************
2019-09-05T08:01:49.6970765Z Test results files: C:\TestAgents\<AgentName>\_work\_temp\TestResults\TestResults\<SystemUserName>_<SystemUserName>_2019-09-05_10_01_49.trx
2019-09-05T08:01:49.6996744Z No Result Found to Publish 'C:\TestAgents\<AgentName>\_work\_temp\TestResults\TestResults\<SystemUserName>_<SystemUserName>_2019-09-05_10_01_49.trx'.
2019-09-05T08:01:49.6997226Z Updating test results: 0
2019-09-05T08:01:49.7412514Z Publishing test results to test run '1099724'.
2019-09-05T08:01:49.8136936Z TestResults To Publish 0, Test run id:1099724
2019-09-05T08:01:49.8137817Z Updated test results: 0
2019-09-05T08:01:49.8138046Z Publishing Attachments: 1
2019-09-05T08:01:50.2265922Z ##[warning]Failed to upload file <SystemUserName>_<SystemUserName>_2019-09-05_10_01_49.trx to Blob Transfer exception with errorcode Unknown, exception message Microsoft.WindowsAzure.Storage.DataMovement.TransferException: The transfer failed. ---> Microsoft.WindowsAzure.Storage.StorageException: De externe server heeft een fout geretourneerd: (403) Niet toegestaan. ---> System.Net.WebException: De externe server heeft een fout geretourneerd: (403) Niet toegestaan.
2019-09-05T08:01:50.2266629Z    bij Microsoft.WindowsAzure.Storage.Shared.Protocol.HttpResponseParsers.ProcessExpectedStatusCodeNoException[T](HttpStatusCode expectedStatusCode, HttpStatusCode actualStatusCode, T retVal, StorageCommandBase`1 cmd, Exception ex)
2019-09-05T08:01:50.2266842Z    bij Microsoft.WindowsAzure.Storage.Blob.CloudBlob.<>c__DisplayClass22.<FetchAttributesImpl>b__21(RESTCommand`1 cmd, HttpWebResponse resp, Exception ex, OperationContext ctx)
2019-09-05T08:01:50.2267026Z    bij Microsoft.WindowsAzure.Storage.Core.Executor.Executor.EndGetResponse[T](IAsyncResult getResponseResult)
2019-09-05T08:01:50.2267217Z    --- Einde van intern uitzonderingsstackpad ---
2019-09-05T08:01:50.2267382Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.BlockBlobWriter.HandleFetchAttributesResult(Exception e)
2019-09-05T08:01:50.2267541Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.BlockBlobWriter.<FetchAttributesAsync>d__18.MoveNext()
2019-09-05T08:01:50.2267710Z --- Einde van stacktracering vanaf vorige locatie waar uitzondering is opgetreden ---
2019-09-05T08:01:50.2267865Z    bij System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2019-09-05T08:01:50.2268019Z    bij System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2019-09-05T08:01:50.2268987Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.BlockBlobWriter.<DoWorkInternalAsync>d__17.MoveNext()
2019-09-05T08:01:50.2269177Z --- Einde van stacktracering vanaf vorige locatie waar uitzondering is opgetreden ---
2019-09-05T08:01:50.2269332Z    bij System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2019-09-05T08:01:50.2269516Z    bij System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2019-09-05T08:01:50.2269676Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.SyncTransferController.<DoWorkInternalAsync>d__13.MoveNext()
2019-09-05T08:01:50.2269829Z --- Einde van stacktracering vanaf vorige locatie waar uitzondering is opgetreden ---
2019-09-05T08:01:50.2269996Z    bij System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2019-09-05T08:01:50.2270152Z    bij System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2019-09-05T08:01:50.2270317Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.TransferControllerBase.<DoWorkAsync>d__33.MoveNext()
2019-09-05T08:01:50.2270485Z --- Einde van stacktracering vanaf vorige locatie waar uitzondering is opgetreden ---
2019-09-05T08:01:50.2270639Z    bij System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2019-09-05T08:01:50.2270798Z    bij System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2019-09-05T08:01:50.2271044Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferScheduler.<ExecuteJobInternalAsync>d__22.MoveNext()
2019-09-05T08:01:50.2271202Z    --- Einde van intern uitzonderingsstackpad ---
2019-09-05T08:01:50.2271358Z    bij Microsoft.TeamFoundation.TestClient.PublishTestResults.TestLogStore.<_executeWithRetry>d__32.MoveNext()
2019-09-05T08:01:50.2271527Z --- Einde van stacktracering vanaf vorige locatie waar uitzondering is opgetreden ---
2019-09-05T08:01:50.2271679Z    bij System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2019-09-05T08:01:50.2271841Z    bij System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2019-09-05T08:01:50.2272017Z    bij Microsoft.TeamFoundation.TestClient.PublishTestResults.TestLogStore.<UploadInternalAsync>d__18.MoveNext()
2019-09-05T08:01:50.4566292Z Failed tests: 12; Total tests: 12;
2019-09-05T08:01:50.5259988Z Total failed tests as return by TCM:12 
2019-09-05T08:01:50.5260484Z Found 1 filtered test case sources.
2019-09-05T08:01:50.5290895Z **************** Rerunning failed tests for Test run 1099724 *********************
2019-09-05T08:01:50.5291282Z Max attempts: 2; Current attempt: 2; Failed test cases threshold: 100; Failed test cases max limit: 0
2019-09-05T08:01:50.5291564Z [command]C:\TestAgents\<AgentName>\_work\_tool\VsTest\16.3.0-preview-20190828-03\x64\tools\net451\Common7\IDE\Extensions\TestPlatform\vstest.console.exe "@C:\Users\<SystemUserName>\AppData\Local\Temp\tmpF56F.tmp"
2019-09-05T08:01:50.6544088Z Microsoft (R) Test Execution Command Line Tool Version 16.3.0-preview-20190828-03
2019-09-05T08:01:50.6544741Z Copyright (c) Microsoft Corporation.  All rights reserved.
2019-09-05T08:01:50.7116621Z vstest.console.exe /TestCaseFilter:"<>"
2019-09-05T08:01:50.7582652Z "C:\TestAgents\<AgentName>\_work\2\a\SysteemIntegratieTest\SysteemIntegratieTest\<TestDLLName>"
2019-09-05T08:01:50.8060020Z /Settings:"C:\TestAgents\<AgentName>\_work\_temp\vtja5oiq5kx.runsettings"
2019-09-05T08:01:50.8860593Z /Logger:"trx"
2019-09-05T08:01:50.9146492Z /TestAdapterPath:"C:\TestAgents\<AgentName>\_work\2\a\SysteemIntegratieTest"
2019-09-05T08:01:51.5865677Z Starting test execution, please wait...
2019-09-05T08:01:51.7217540Z A total of 1 test files matched the specified pattern.
2019-09-05T08:01:53.4867405Z NUnit Adapter 3.13.0.0: Test execution started
2019-09-05T08:01:53.5089417Z ##[error]An exception occurred while invoking executor 'executor://nunit3testexecutor/': Incorrect format for TestCaseFilter Error: Invalid Condition '<>'. Specify the correct format and try again. Note that the incorrect format can lead to no test getting executed.
2019-09-05T08:01:53.8486761Z Results File: C:\TestAgents\<AgentName>\_work\_temp\.\TestResults\TestResults\<SystemUserName>_<SystemUserName>_2019-09-05_10_01_53.trx
2019-09-05T08:01:53.8509208Z ##[error]Test Run Failed.
2019-09-05T08:01:53.8887348Z Vstest.console.exe exited with code 1.
2019-09-05T08:01:53.8891484Z **************** Completed test execution *********************
2019-09-05T08:01:53.8895348Z Test results files: C:\TestAgents\<AgentName>\_work\_temp\TestResults\TestResults\<SystemUserName>_<SystemUserName>_2019-09-05_10_01_53.trx
2019-09-05T08:01:53.8896086Z No Result Found to Publish 'C:\TestAgents\<AgentName>\_work\_temp\TestResults\TestResults\<SystemUserName>_<SystemUserName>_2019-09-05_10_01_53.trx'.
2019-09-05T08:01:53.8896747Z Updating test results: 0
2019-09-05T08:01:53.9135193Z Publishing test results to test run '1099724'.
2019-09-05T08:01:53.9785983Z TestResults To Publish 0, Test run id:1099724
2019-09-05T08:01:53.9786558Z Updated test results: 0
2019-09-05T08:01:53.9786762Z Publishing Attachments: 1
2019-09-05T08:01:54.4055405Z ##[warning]Failed to upload file <SystemUserName>_<SystemUserName>_2019-09-05_10_01_53.trx to Blob Transfer exception with errorcode Unknown, exception message Microsoft.WindowsAzure.Storage.DataMovement.TransferException: The transfer failed. ---> Microsoft.WindowsAzure.Storage.StorageException: De externe server heeft een fout geretourneerd: (403) Niet toegestaan. ---> System.Net.WebException: De externe server heeft een fout geretourneerd: (403) Niet toegestaan.
2019-09-05T08:01:54.4056004Z    bij Microsoft.WindowsAzure.Storage.Shared.Protocol.HttpResponseParsers.ProcessExpectedStatusCodeNoException[T](HttpStatusCode expectedStatusCode, HttpStatusCode actualStatusCode, T retVal, StorageCommandBase`1 cmd, Exception ex)
2019-09-05T08:01:54.4056212Z    bij Microsoft.WindowsAzure.Storage.Blob.CloudBlob.<>c__DisplayClass22.<FetchAttributesImpl>b__21(RESTCommand`1 cmd, HttpWebResponse resp, Exception ex, OperationContext ctx)
2019-09-05T08:01:54.4056394Z    bij Microsoft.WindowsAzure.Storage.Core.Executor.Executor.EndGetResponse[T](IAsyncResult getResponseResult)
2019-09-05T08:01:54.4056556Z    --- Einde van intern uitzonderingsstackpad ---
2019-09-05T08:01:54.4056719Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.BlockBlobWriter.HandleFetchAttributesResult(Exception e)
2019-09-05T08:01:54.4056892Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.BlockBlobWriter.<FetchAttributesAsync>d__18.MoveNext()
2019-09-05T08:01:54.4057046Z --- Einde van stacktracering vanaf vorige locatie waar uitzondering is opgetreden ---
2019-09-05T08:01:54.4057201Z    bij System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2019-09-05T08:01:54.4057370Z    bij System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2019-09-05T08:01:54.4057537Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.BlockBlobWriter.<DoWorkInternalAsync>d__17.MoveNext()
2019-09-05T08:01:54.4057694Z --- Einde van stacktracering vanaf vorige locatie waar uitzondering is opgetreden ---
2019-09-05T08:01:54.4058204Z    bij System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2019-09-05T08:01:54.4058397Z    bij System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2019-09-05T08:01:54.4058559Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.SyncTransferController.<DoWorkInternalAsync>d__13.MoveNext()
2019-09-05T08:01:54.4058732Z --- Einde van stacktracering vanaf vorige locatie waar uitzondering is opgetreden ---
2019-09-05T08:01:54.4058886Z    bij System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2019-09-05T08:01:54.4059043Z    bij System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2019-09-05T08:01:54.4059223Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.TransferControllerBase.<DoWorkAsync>d__33.MoveNext()
2019-09-05T08:01:54.4059378Z --- Einde van stacktracering vanaf vorige locatie waar uitzondering is opgetreden ---
2019-09-05T08:01:54.4059540Z    bij System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2019-09-05T08:01:54.4059711Z    bij System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2019-09-05T08:01:54.4059885Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferScheduler.<ExecuteJobInternalAsync>d__22.MoveNext()
2019-09-05T08:01:54.4060040Z    --- Einde van intern uitzonderingsstackpad ---
2019-09-05T08:01:54.4060213Z    bij Microsoft.TeamFoundation.TestClient.PublishTestResults.TestLogStore.<_executeWithRetry>d__32.MoveNext()
2019-09-05T08:01:54.4060367Z --- Einde van stacktracering vanaf vorige locatie waar uitzondering is opgetreden ---
2019-09-05T08:01:54.4060719Z    bij System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2019-09-05T08:01:54.4060892Z    bij System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2019-09-05T08:01:54.4061049Z    bij Microsoft.TeamFoundation.TestClient.PublishTestResults.TestLogStore.<UploadInternalAsync>d__18.MoveNext()
2019-09-05T08:01:54.5485302Z ##[warning]Maximum number of attempts running the failed tests reached: 2
2019-09-05T08:01:54.6322601Z Execution Result Code 1 is non zero, checking for failed results
2019-09-05T08:01:54.6732553Z Completed TestExecution Model...
2019-09-05T08:01:54.7235363Z ##[warning]Vstest failed with error. Check logs for failures. There might be failed tests.
2019-09-05T08:01:54.7236019Z ##[error]Error: The process 'C:\TestAgents\<AgentName>\_work\_tasks\VSTest_ef087383-ee5e-42c7-9a53-ab56c98420f9\2.156.2\Modules\DTAExecutionHost.exe' failed with exit code 1
2019-09-05T08:01:54.7238465Z ##[error]Vstest failed with error. Check logs for failures. There might be failed tests.
2019-09-05T08:01:54.7492221Z ##[section]Finishing: VsTest - testAssemblies

Error logs

2019-09-05T08:01:54.4055405Z ##[warning]Failed to upload file <Filename>.trx to Blob Transfer exception with errorcode Unknown, exception message Microsoft.WindowsAzure.Storage.DataMovement.TransferException: The transfer failed. ---> Microsoft.WindowsAzure.Storage.StorageException: De externe server heeft een fout geretourneerd: (403) Niet toegestaan. ---> System.Net.WebException: De externe server heeft een fout geretourneerd: (403) Niet toegestaan.
2019-09-05T08:01:54.4056004Z    bij Microsoft.WindowsAzure.Storage.Shared.Protocol.HttpResponseParsers.ProcessExpectedStatusCodeNoException[T](HttpStatusCode expectedStatusCode, HttpStatusCode actualStatusCode, T retVal, StorageCommandBase`1 cmd, Exception ex)
2019-09-05T08:01:54.4056212Z    bij Microsoft.WindowsAzure.Storage.Blob.CloudBlob.<>c__DisplayClass22.<FetchAttributesImpl>b__21(RESTCommand`1 cmd, HttpWebResponse resp, Exception ex, OperationContext ctx)
2019-09-05T08:01:54.4056394Z    bij Microsoft.WindowsAzure.Storage.Core.Executor.Executor.EndGetResponse[T](IAsyncResult getResponseResult)
2019-09-05T08:01:54.4056556Z    --- Einde van intern uitzonderingsstackpad ---
2019-09-05T08:01:54.4056719Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.BlockBlobWriter.HandleFetchAttributesResult(Exception e)
2019-09-05T08:01:54.4056892Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.BlockBlobWriter.<FetchAttributesAsync>d__18.MoveNext()
2019-09-05T08:01:54.4057046Z --- Einde van stacktracering vanaf vorige locatie waar uitzondering is opgetreden ---
2019-09-05T08:01:54.4057201Z    bij System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2019-09-05T08:01:54.4057370Z    bij System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2019-09-05T08:01:54.4057537Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.BlockBlobWriter.<DoWorkInternalAsync>d__17.MoveNext()
2019-09-05T08:01:54.4057694Z --- Einde van stacktracering vanaf vorige locatie waar uitzondering is opgetreden ---
2019-09-05T08:01:54.4058204Z    bij System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2019-09-05T08:01:54.4058397Z    bij System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2019-09-05T08:01:54.4058559Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.SyncTransferController.<DoWorkInternalAsync>d__13.MoveNext()
2019-09-05T08:01:54.4058732Z --- Einde van stacktracering vanaf vorige locatie waar uitzondering is opgetreden ---
2019-09-05T08:01:54.4058886Z    bij System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2019-09-05T08:01:54.4059043Z    bij System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2019-09-05T08:01:54.4059223Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.TransferControllerBase.<DoWorkAsync>d__33.MoveNext()
2019-09-05T08:01:54.4059378Z --- Einde van stacktracering vanaf vorige locatie waar uitzondering is opgetreden ---
2019-09-05T08:01:54.4059540Z    bij System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2019-09-05T08:01:54.4059711Z    bij System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2019-09-05T08:01:54.4059885Z    bij Microsoft.WindowsAzure.Storage.DataMovement.TransferScheduler.<ExecuteJobInternalAsync>d__22.MoveNext()
2019-09-05T08:01:54.4060040Z    --- Einde van intern uitzonderingsstackpad ---
2019-09-05T08:01:54.4060213Z    bij Microsoft.TeamFoundation.TestClient.PublishTestResults.TestLogStore.<_executeWithRetry>d__32.MoveNext()
2019-09-05T08:01:54.4060367Z --- Einde van stacktracering vanaf vorige locatie waar uitzondering is opgetreden ---
2019-09-05T08:01:54.4060719Z    bij System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2019-09-05T08:01:54.4060892Z    bij System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
2019-09-05T08:01:54.4061049Z    bij Microsoft.TeamFoundation.TestClient.PublishTestResults.TestLogStore.<UploadInternalAsync>d__18.MoveNext()

[ShreyasRmsft]

@Shortcheese you will need to add a whitelist for the attachment store

docs here https://docs.microsoft.com/en-us/azure/devops/organizations/security/faq-network-connections?view=azure-devops

this is the attachment specific one, dropping it here for your convenience https://*.vstmrblob.vsassets.io

But make sure you go through the entire list in the docs to ensure you have everything configured correctly.

[kaadhina]

Closing this. Please get back if the above did not help solve the issue.

[andersthorsen]

@ShreyasRmsft What do you mean by adding a white list? Do you mean that everyone using Azure devops with on premise connections must open a connection in the firewall?

Is a proxy not supporter for this scenario?

I’m also seeing this problem and it seems testing of DevOps agent with a proxy not done often.

[Shortcheese]

I concur with @andersthorsen. As a workaround our network engineers have put an exception on our firewall rules. ( And i simply forgot this issue *shame on me *)
But that is not a real solution. Especially because azure and its agents provides proper proxy settings and support. And most tasks works with it very well.

[ShreyasRmsft]

@andersthorsen this path for attachments is only taken in the hosted service and not onprem. We store attachments as blobs in the hosted version. In onprem you will not run into this.

I had meant putting a whitelist for this url on the proxy server machine and not the client machine. If your proxy server is not blocking this call and it is indeed the task code that is not using the proxy then yes it might be a bug on our end and we will fix it asap.

[andersthorsen]

What we're seeing is similar to this. Let me know if I should raise a different issue if it's not the same.

I've pasted parts of the log below.

We're behind a corporate proxy (like the one described by the original poster) which I've been told does not block any of those addresses. We've configured the proxy with the agent and it works with most tasks, but not all.

Network tasks that work fine are nuget, and the old artifact publishing task. (The newer pipeline artifact task fail during on premises deployment download somewhere deep inside the bowels of the Azure SDK but that's a different proxy issue than this most likely)

The test task worked fine a while ago but now it's failing. Unfortunately we use a mix of cloud builds, where it works fine and on premise builds for improved performance when needed but the vs test task now fails. The tests take ~1 minute to run but the task times out after ~6-8 minutes, both increasing the time and not providing test statistics any longer.

[warning]Failed to upload file __2019-10-09_09_10_57.trx to Blob Transfer exception with errorcode Unknown, exception message Microsoft.WindowsAzure.Storage.DataMovement.TransferException: The transfer failed. ---> Microsoft.WindowsAzure.Storage.StorageException: Unable to connect to the remote server ---> System.Net.WebException: Unable to connect to the remote server ---> System.Net.Sockets.SocketException: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond 13.107.6.175:443

at System.Net.Sockets.Socket.InternalEndConnect(IAsyncResult asyncResult)
at System.Net.Sockets.Socket.EndConnect(IAsyncResult asyncResult)
at System.Net.ServicePoint.ConnectSocketInternal(Boolean connectFailure, Socket s4, Socket s6, Socket& socket, IPAddress& address, ConnectSocketState state, IAsyncResult asyncResult, Exception& exception)
--- End of inner exception stack trace ---
at System.Net.HttpWebRequest.EndGetResponse(IAsyncResult asyncResult)
at Microsoft.WindowsAzure.Storage.Core.Executor.Executor.EndGetResponseT
--- End of inner exception stack trace ---
at Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.BlockBlobWriter.HandleFetchAttributesResult(Exception e)
at Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.BlockBlobWriter.d__18.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.BlockBlobWriter.d__17.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.SyncTransferController.d__13.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.TransferControllerBase.d__33.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.WindowsAzure.Storage.DataMovement.TransferScheduler.d__22.MoveNext()
--- End of inner exception stack trace ---
at Microsoft.TeamFoundation.TestClient.PublishTestResults.TestLogStore.<_executeWithRetry>d__32.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.TeamFoundation.TestClient.PublishTestResults.TestLogStore.d__18.MoveNext()

[navin22]

@Shortcheese and @andersthorsen I am working on to fix this, will update you guys once the fix is rolled out.

[navin22]

@Shortcheese and @andersthorsen Please check this issue in the latest version of vstest 2.160.1 and let us know if there are any issues.

[andersthorsen]

@navin22 Tested using the Visual Studio Test installer (latest) and it works great. Our pielines suddenly lost their ~5-10 minute delay and test results are visible in AzureDevOps again !

Thanks!