Issue/1126 - quickgelu, gelutanh #4956

Job	Run time
Build (ubuntu-latest, debug)	16m 51s
Build (windows-latest, debug)	22m 1s
Build (ubuntu-latest, release)	17m 1s
Build (windows-latest, release)	20m 36s
	1h 16m 29s

Provide feedback