Faster benchmarking smoke tests #3150

Job	Run time
Backport directly from a pull request	0s
Backport a specific PR against a specific branch	-8s
	-8s

Provide feedback