Template engine tests hitting known parallelism issue in GetVisualStudioInstances

[marcpopMSFT]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=869444
Build error leg or test failing: Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewInstantiateTests.CanInstantiateTemplate_WithConditions_BasedOnFileName
Pull request: #44859

Error Message

{
  "ErrorMessage": "57005",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=869444
Error message validated: [57005]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 11/14/2024 7:41:30 PM UTC

Report

Build	Definition	Step Name	Console log	Pull Request
2985513	dotnet-sdk	Download secrets: HelixProdKV	Log
1436899	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53950
2985288	dotnet-sdk	🟣 Build	Log
1422752	dotnet/sdk	🟣 Build	Log	#54330
1436463	dotnet/sdk	🟣 Run FullFramework Tests	Log	#54410
2984828	dotnet-sdk	🟣 Build	Log
1436072	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54346
1436051	dotnet/sdk	🟣 Build	Log	#54336
2984531	dotnet-sdk	🟣 Build	Log
2984227	dotnet-sdk	🟣 Build	Log
1432685	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54419
2982249	dotnet-sdk	NuGetAuthenticate@1	Log
2981928	dotnet-sdk	NuGetAuthenticate@1	Log
1431541	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54337
2981352	dotnet-sdk	Run Tests in Helix and non Helix in parallel	Log	#61441
1430487	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54231
2979940	dotnet-sdk	🟣 Build	Log
2979560	dotnet-sdk	NuGetAuthenticate@1	Log
1427508	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54336
2979240	dotnet-sdk	🟣 Build	Log
1421610	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54313
2978171	dotnet-sdk	🟣 Build	Log
2977949	dotnet-sdk	🟣 Build	Log
1424970	dotnet/sdk	Build	Log	#54328
2977617	dotnet-sdk	NuGetAuthenticate@1	Log
1424363	dotnet/sdk	🟣 Build	Log	#54093
1423459	dotnet/sdk	🟣 Build	Log	#54328
2976094	dotnet-sdk	Download secrets: EngKeyVault	Log
1422486	dotnet/sdk	Sync repo into VMR (Unix)	Log	#54328
1421631	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54317
2975367	dotnet-sdk	NuGetAuthenticate@1	Log
1421349	dotnet/sdk	🟣 Run TestBuild Tests	Log
2975243	dotnet-sdk	🟣 Build	Log
2975065	dotnet-sdk	NuGetAuthenticate@1	Log	#60782
1420146	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54302
1419820	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54292
1419837	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54253
1419593	dotnet/sdk	🟣 Run TestBuild Tests	Log
2973801	dotnet-sdk	🟣 Build	Log
2973687	dotnet-sdk	Run Tests	Log	#60806
2973720	dotnet-sdk	Build	Log
2973701	dotnet-sdk	Build	Log	#60808
1416849	dotnet/sdk	Run FullFramework Tests	Log	#54261
2973559	dotnet-sdk	NuGetAuthenticate@1	Log
2973493	dotnet-sdk	Download secrets: HelixProdKV	Log
1417832	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54133
1416963	dotnet/sdk	🟣 Run FullFramework Tests	Log	#53835
2972404	dotnet-sdk	Generate delegation SAS Token for dotnetbuilds/internal	Log
2972280	dotnet-sdk	Build	Log	#60891
2972259	dotnet-sdk	🟣 Run dotnet-format on dotnet/aspnetcore AspNetCore.sln	Log	#56995
2970549	dotnet-sdk	🟣 Build	Log
2972238	dotnet-sdk	Build (azureLinux30fpm)	Log
2972233	dotnet-sdk	Build (azureLinux30fpm)	Log
2972184	dotnet-sdk	🟣 Build	Log
1415904	dotnet/sdk	🟣 Build	Log
1415625	dotnet/sdk	🟣 Build	Log
2972042	dotnet-sdk	🟣 Build	Log
2970539	dotnet-sdk	Build (debian12Amd64)	Log	#60839
2970522	dotnet-sdk	Build	Log	#60891
1413675	dotnet/sdk	🟣 Build	Log	#53971
1413559	dotnet/sdk	🟣 Build	Log	#54205
2969894	dotnet-sdk	Run FullFramework Tests	Log	#60836
1412934	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53971
1412809	dotnet/sdk	🟣 Build	Log	#54226
2969029	dotnet-sdk	Build Cache Updater	Log
2968840	dotnet-sdk	Build	Log	#60849
2968807	dotnet-sdk	Build	Log	#60839
1410296	dotnet/sdk	🟣 Build	Log	#53948
1410295	dotnet/sdk	🟣 Build	Log	#53945
1409245	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54159
2967756	dotnet-sdk	🛡 Guardian: BinSkim 4.4.9	Log
2967703	dotnet-sdk	🟣 Build	Log
1406894	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54078
1405793	dotnet/sdk	🟣 Build	Log	#54097
1403256	dotnet/sdk	🟣 Run FullFramework Tests	Log	#54154
1405265	dotnet/sdk	🟣 Build	Log
1404592	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54161
1403979	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53847
1402970	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53847
1402784	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54153
1402273	dotnet/sdk	Run Tests	Log	#53847
1401893	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54134
2963215	dotnet-sdk	🟣 Build	Log
2963145	dotnet-sdk	Build	Log	#60565
2963096	dotnet-sdk	Build	Log	#60566
2962983	dotnet-sdk	Build	Log	#60566
1400917	dotnet/sdk	🟣 Run TestBuild Tests	Log	#53333
1400964	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54135
1400827	dotnet/sdk	🟣 Run TestBuild Tests	Log	#54134
2962549	dotnet-sdk	🟣 Build	Log
1400359	dotnet/sdk	🟣 Build	Log	#54114
1399661	dotnet/sdk	🟣 Run FullFramework Tests	Log	#54122
1399750	dotnet/sdk	🟣 Build	Log
1399662	dotnet/sdk	🟣 Build	Log	#54123

Build	Definition	Test	Pull Request
1430490	dotnet/sdk	dotnet-new.IntegrationTests.dll.3.WorkItemExecution	#54384
1430254	dotnet/sdk	dotnet.Tests.dll.21.WorkItemExecution	#54390
1419998	dotnet/sdk	dotnet.Tests.dll.9.WorkItemExecution	#54301
2970601	dotnet-sdk	Microsoft.NET.Sdk.Razor.Tests.StaticWebAssetsAppWithPackagesIntegrationTest.Microsoft.NET.Sdk.Razor.Tests.StaticWebAssetsAppWithPackagesIntegrationTest.PublishProjectWithReferences_PublishSingleFile_GeneratesPublishJsonManifestAndCopiesPublishAssets	#60902

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
6	18	98

[BrennanConroy]

Template engine tests hitting known parallelism issue in GetVisualStudioInstances

Is there an issue describing the problem? Are there people working on fixing it? We're hitting this in the aspnetcore repo a lot and as far as I'm aware we don't do anything with UWP which is how the sdk resolved the problem.

[baronfel]

@jaredpar sent a PR here with a short-term workaround that we're working to merge: #44930

The 'true' fix is coming in a future VS release, there was some unintended concurrent access to a critical section that wasn't locked.

[tmat]

@baronfel @jaredpar should this issue be closed?

[baronfel]

I don't think so - the tracker is still making recent edits, which impliies it's still being hit.

[tmat]

So the fix above didn't fix it?