Skip to content
This repository was archived by the owner on Aug 2, 2025. It is now read-only.
This repository was archived by the owner on Aug 2, 2025. It is now read-only.

Research preview streaming with the new Generator Handler #35

@davefojtik

Description

@davefojtik

RunPod's new Generator Handler allows fetching /stream endpoint to get continuous updates on a job without the need for RunPod to send updates to your server as it had to be done previously.

The maximum size for a payload that can be sent using yield to stream results is 1 MB.

Needed steps are:

  • Check if this limit is not exceeded in any situation.
  • Change the handler type to the Generator one
  • Add code that will yield previews to the handler
  • Test it

Metadata

Metadata

Assignees

No one assigned

    Labels

    good first issueGood issue to start contributingoptimizationPerformance and code improvements

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions