Add LRU cache for get_generator Functionality

[rdheekonda]

Notes

• Minor Performance Improvement: Avoids redundant computations for frequently used generators in a pipeline.

---

Generated Summary

• Introduced lru_cache for the get_generator function to optimize performance by caching results of expensive function calls.
• Cleaned up method signatures across Generator and chat methods for improved clarity.
• Adjusted type annotation formatting for consistency and readability.
• No functional changes were made to the logic; the modifications primarily streamline the codebase and enhance efficiency.

This summary was generated with ❤️ by rigging

[monoxgas]

LGTM