Add env variables to configure manifest cache #7633

Job	Run time
integration-test-gcs	1m 13s
integration-test-adls	1m 18s
integration-test	10m 13s
integration-test-s3	1m 8s
lint-and-unit-test (3.10)	2m 44s
lint-and-unit-test (3.13)	2m 43s
lint-and-unit-test (3.11)	2m 43s
lint-and-unit-test (3.12)	2m 58s
integration-coverage-report	35s
	25m 35s

Provide feedback