feat: enable publishing pipelines and indexes to deepset AI platfrom

[faymarie]

Related Issues

• fixes https://deepset.atlassian.net/jira/software/c/projects/DC/boards/11?selectedIssue=DC-4086

    Usage publishing an index:
    Run `deepset-cloud login` and follow the instructions to authenticate to deepset AI platform.
    
```python
    from haystack import Pipeline
    from deepset_cloud_sdk.workflows import DeepsetSDK, IndexConfig, IndexInputs,
   
    sdk = DeepsetSDK()
    sdk.init()
    
# define your Haystack Pipeline
    pipeline = Pipeline()
   
 # add components to the pipeline and connect them...
 
# define your publish config
   publish_config = IndexConfig(
    name="haystack-index-1",
    inputs=IndexInputs(
        files=["file_classifier.sources"],
    ),
)

    # Option: async execution
    asyncio.run(pipeline.publish_async(pipeline=pipeline, config=publish_config))

   # Option: sync execution
   pipeline_index.publish(config=publish_config)

Proposed Changes?

Allows adding Haystack Pipeline and AsyncPipeline as Pipeline or Index to deepset AI platform as a ymal string.
Adds inputs and outputs.

Secrets, AnswerBuilder, DocumentStores, return values etc will be managed in separate PRs!

How did you test it?

Notes for the reviewer

Screenshots (optional)

Checklist

• I have updated the referenced issue with new insights and changes
• If this is a code change, I have added unit tests
• I've used the conventional commit specification for my PR title
• I updated the docstrings
• If this is a code change, I added meaningful logs and prepared Datadog visualizations and alerts

[ArzelaAscoIi]

looking good already! Some comments about the DX. Looking forward to have this feature!

(Iiiiiif you could add an integration tests that actually pushes a pipeline to the cloud, would be amazing btw.)

[wochinge]

Left more general comments as of now.

In general very good first throw! I especially like the naming (publish, workflows) and it's already fairly intuitive!

[github-actions]

Coverage report

Click to see where and how coverage changed

File	Statements	Missing	Coverage	Coverage (new stmts)	Lines missing
deepset_cloud_sdk/workflows
__init__.py
sdk.py
deepset_cloud_sdk/workflows/pipeline_client
__init__.py
models.py
pipeline_service.py					32, 40, 86-89, 95, 139-140, 196, 213
Project Total

This report was generated by python-coverage-comment-action

[ArzelaAscoIi]

Looks good!

[wochinge]

A few smaller questions but looks good to me already.

What are the next steps? Secrets & OpenSearch?