Skip to content

Reference output topics of components from other pipelines #513

@philipp94831

Description

@philipp94831

Currently it is only possible to reference output topics of components within the same pipeline. It would be great to have a mechanism to also reference the output topic of anothers piplines components. A syntax I could imagine would be

- type: streams-app
  from:
    components:
      /my/other/pipeline:my-component:
        type: input
      ..:my-component:
        type: input
      my/sub/pipeline:my-component:
        type: input
      my-component:
        type: input

Alternatively (but would be breaking and a bit awkward)

- type: streams-app
  from:
    pipelines:
      /my/other/pipeline:
        components:
          my-component:
            type: input
      ..:
        components:
          my-component:
            type: input
      my/sub/pipeline:
        components:
          my-component:
            type: input
      .:
        components:
          my-component:
            type: input

If pipeline is omited, the behavior does not change, i.e., a component within the same pipeline is referenced.

As a follow-up: deploy --from-step my/pipeline/alignment

Metadata

Metadata

Assignees

No one assigned

    Labels

    component/generatorRelated to the generation of pipeline.yaml

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions