Upgrade skypilot executor with 0.9.2

[twmeissane]

Updates follow migration guidelines: https://docs.skypilot.co/en/latest/reference/faq.html\#migration-from-skypilot-0-8-1 Minor documentation improvement to ensure package compatibility during installation of sky

Co-authored by: sahger.lad@thoughtworks.com rahul.punjabi@thoughtworks.com

[hemildesai]

Thank you so much for the contribution 🎉 . Other packagers should also be compatible with Skypilot now, will add support in a follow up PR.

Do the logs work fine with the upgrade? If not, we can follow up with a fix in a separate PR as well.

[hemildesai]

You might need to fix the formatting according to Ruff format / format (pull_request) for the CI check to pass. We can merge afterwards.

[twmeissane]

Thank you so much for the contribution 🎉 . Other packagers should also be compatible with Skypilot now, will add support in a follow up PR.

Do the logs work fine with the upgrade? If not, we can follow up with a fix in a separate PR as well.

Hi @hemildesai the logs work fine on our end and they are available when we train on a single node. However when we move to multiple node we do encounter some issues both in v0.8 and v0.9 around the working directly /nemo_run/code. We believe this is potentially just come misconfiguration on our end.

[hemildesai]

Hi @hemildesai the logs work fine on our end and they are available when we train on a single node. However when we move to multiple node we do encounter some issues both in v0.8 and v0.9 around the working directly /nemo_run/code. We believe this is potentially just come misconfiguration on our end.

The working dir should be synced from local filesystem to /nemo_run/code on all the nodes. If that is not the case, feel free to file an issue and we can help investigate deeper.