[Feature]: Infrastructure Changes for New Models

[govind-ramnarayan]

🚀 The feature, motivation and pitch

We want to first merge all the infrastructure changes required for merging all the custom model files and tests. This will also resolve #12573 by making the default torch-cudagraph instead of torch-compile

Alternatives

No response

Additional context

No response

Before submitting a new issue...

• Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.