Skip to content

Add served-model support to serving endpoint query#1044

Closed
aidint wants to merge 1 commit into
databricks:mainfrom
aidint:main
Closed

Add served-model support to serving endpoint query#1044
aidint wants to merge 1 commit into
databricks:mainfrom
aidint:main

Conversation

@aidint

@aidint aidint commented Sep 15, 2025

Copy link
Copy Markdown

What changes are proposed in this pull request?

This PR adds support for querying an individual model in the serving endpoints as documented here.

  • WHAT changes are being made in the PR?
    It adds served-models to the url used for the query requests if served_model_name is provided.
  • WHY are these changes needed?
    While querying an individual model behind a serving endpoint is supported by rest api, it is not supported by the sdk. This limits users flexibility in serving multiple models in one endpoint. I raised this problem in this issue.

How is this tested?

I tested this with an endpoint in a private databricks workspace.

Describe any tests you have done; especially if test tests are not part of
the unit tests (e.g. local tests).

I couldn't find any test case for the query methods, therefore the answer is N/A.

Signed-off-by: Aidin Tavvafi <at.aidin@gmail.com>
@github-actions

Copy link
Copy Markdown

Please ensure that the NEXT_CHANGELOG.md file is updated with any relevant changes.
If this is not necessary for your PR, please include the following in your PR description:
NO_CHANGELOG=true
and rerun the job.

@github-actions

Copy link
Copy Markdown

If integration tests don't run automatically, an authorized user can run them manually by following the instructions below:

Trigger:
go/deco-tests-run/sdk-py

Inputs:

  • PR number: 1044
  • Commit SHA: 0fba34c9ff53b99cbfd78a3fef98c43b5fd0ef94

Checks will be approved automatically on success.

@aidint

aidint commented Sep 15, 2025

Copy link
Copy Markdown
Author

@hectorcast-db can you please help me with this PR?

@aidint

aidint commented Sep 19, 2025

Copy link
Copy Markdown
Author

@rauchy can you please review this pull request?

@hectorcast-db

Copy link
Copy Markdown
Contributor

Hi @aidint
Thanks for reaching out and the PR.
Unfortunately, we cannot merge this PR. The code for services is auto generated, so any manual change will be automatically reverted.
I will forward this to the team so they can update their configuration upstream.

@aidint aidint closed this Nov 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants