Rewrite attention sink from eviction to ring buffer (#18821) #2270

Job	Run time
test-arm / test-backend-linux (arm_vgf_fp, models) / linux-job	27m 23s
test-arm / test-backend-linux (arm_tosa_fp, models) / linux-job	25m 59s
test-arm / test-backend-linux (arm_vgf_fp, operators) / linux-job	16m 53s
test-arm / test-backend-linux (arm_tosa_fp, operators) / linux-job	18m 39s
test-arm / test-backend-macos	0s
test-arm / package-golden-artifacts	41s
	1h 29m 35s

Provide feedback