Add fabric-cosmos-spark-auth_4-0_2-13 for Spark 4.0 / Fabric Runtime 2.0 by xinlian12 · Pull Request #49096 · Azure/azure-sdk-for-java

xinlian12 · 2026-05-07T21:53:35Z

Summary

Add Spark 4.0 / Scala 2.13 variant of the Fabric Cosmos Spark account data resolver (fabric-cosmos-spark-auth_4-0_2-13), enabling Microsoft Entra ID authentication for Fabric Runtime 2.0 users.

What's New

New module: fabric-cosmos-spark-auth_4-0_2-13
- Identical Scala source code to fabric-cosmos-spark-auth_3
- Dependencies updated from Scala 2.12 → 2.13 suffixes
- Java 17+ required (Spark 4.0 requirement)
- Depends on azure-cosmos-spark_4-0_2-13 connector
- cosmos-spark-version = 4.0
- scalaVersion = 2.13.17

Files Changed

Category	Files
New module	`sdk/cosmos/fabric-cosmos-spark-auth_4-0_2-13/` (pom.xml, CHANGELOG.md, README.md, scalastyle_config.xml, Scala sources, resources)
CI	`sdk/cosmos/ci.yml` — trigger/pr paths, release parameter, artifact entry
Versioning	`eng/versioning/version_client.txt`, `eng/versioning/external_dependencies.txt`
Parent POM	`sdk/cosmos/pom.xml` — added module

Notes

synapseutils_2.13 added to external_dependencies.txt — this artifact is provided by the Fabric Runtime 2.0 environment at runtime
Module naming follows the Spark connector convention: {name}_{spark-major}-{spark-minor}_{scala-major}-{scala-minor}

Generated by coding-agent-harness

Add Spark 4.0 / Scala 2.13 variant of the Fabric Cosmos Spark account data resolver, enabling Microsoft Entra ID authentication for Fabric Runtime 2.0 users. New module: fabric-cosmos-spark-auth_4-0_2-13 - Identical Scala source to fabric-cosmos-spark-auth_3 - Updated dependencies to Scala 2.13 (_2.12 → _2.13) - Java 17+ required (Spark 4.0 requirement) - Depends on azure-cosmos-spark_4-0_2-13 connector - Wired into CI (ci.yml), versioning, and parent POM Implements Azure#48884 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

Copilot

Pull request overview

Adds a new Cosmos Spark “Fabric account data resolver” module targeting Spark 4.0 / Scala 2.13 (Fabric Runtime 2.0), and wires it into Cosmos build/release infrastructure.

Changes:

Added new module fabric-cosmos-spark-auth_4-0_2-13 (POM, Scala implementation, resources, README/CHANGELOG, scalastyle config).
Registered the new module in sdk/cosmos/pom.xml, Cosmos CI pipeline artifact list, and versioning metadata.
Added synapseutils_2.13 to external_dependencies.txt for dependency tracking.

Reviewed changes

Copilot reviewed 12 out of 12 changed files in this pull request and generated 4 comments.

Show a summary per file

File	Description
sdk/cosmos/pom.xml	Includes the new Fabric Spark 4.0/2.13 auth module in the Cosmos multi-module build.
sdk/cosmos/fabric-cosmos-spark-auth_4-0_2-13/src/main/scala/com/azure/cosmos/spark/fabric/FabricAccountDataResolver.scala	Implements the Fabric `AccountDataResolver` for Entra ID access token auth in Spark 4.0 environments.
sdk/cosmos/fabric-cosmos-spark-auth_4-0_2-13/src/main/scala/com/azure/cosmos/spark/fabric/BasicLoggingTrait.scala	Adds basic SLF4J logging helpers used by the resolver.
sdk/cosmos/fabric-cosmos-spark-auth_4-0_2-13/src/main/resources/META-INF/services/com.azure.cosmos.spark.AccountDataResolver	Registers the resolver via Java ServiceLoader.
sdk/cosmos/fabric-cosmos-spark-auth_4-0_2-13/src/main/resources/fabric-cosmos-spark-auth_4-0_2-13.properties	Publishes name/version build properties for the artifact.
sdk/cosmos/fabric-cosmos-spark-auth_4-0_2-13/scalastyle_config.xml	Adds Scala style configuration for the new module.
sdk/cosmos/fabric-cosmos-spark-auth_4-0_2-13/README.md	Documents usage/config for the Spark 4.0/2.13 resolver.
sdk/cosmos/fabric-cosmos-spark-auth_4-0_2-13/pom.xml	Defines dependencies/build (Scala compilation, shading, Java 17 targeting) for the new artifact.
sdk/cosmos/fabric-cosmos-spark-auth_4-0_2-13/CHANGELOG.md	Introduces release history entry for the new module.
sdk/cosmos/ci.yml	Adds CI triggers and a release artifact entry for the new module.
eng/versioning/version_client.txt	Adds the new module to version tracking.
eng/versioning/external_dependencies.txt	Adds `synapseutils_2.13` dependency entry for Cosmos.

- Fix doc links to point to azure-cosmos-spark_3/docs/ (existing location) - Fix grammar: 'signed-in user' -> 'a signed-in user' Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

FabianMeiswinkel

LGTM

synapseutils_2.13:1.5.4 does not exist on Maven Central. The earliest available version for the _2.13 variant is 1.6.2. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

…4-0_2-13 Set cosmos.spark.skip=true for JDK < 17, matching the pattern used by azure-cosmos-spark_4-0_2-13 and azure-cosmos-spark_4-1_2-13. This flows through maven.main.skip to skip both the Java compiler (maven-compiler-plugin) and the Scala compiler (scala-maven-plugin), which supports maven.main.skip. Without this, the scala-maven-plugin attempts to compile with -release 17 on JDK 8/11, causing build failures. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

xinlian12 · 2026-05-08T17:56:31Z

@sdkReviewAgent

xinlian12 · 2026-05-08T18:27:55Z

✅ Review complete (30:28)

Posted 2 inline comment(s).

_{Steps: ✓ context, correctness, cross-sdk, design, history, past-prs, synthesis, test-coverage}

Add the new module's README to known_content_issues to prevent CI doc validation failures, matching the existing fabric-cosmos-spark-auth_3 entry. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

FabianMeiswinkel

LGTM

Copilot AI review requested due to automatic review settings May 7, 2026 21:53

xinlian12 requested review from a team, JonathanGiles, Netyyyy, alzimmermsft, g2vinay, kirankumarkolli, moarychan, rujche, samvaity and saragluna as code owners May 7, 2026 21:53

github-actions Bot added the Cosmos label May 7, 2026

Copilot started reviewing on behalf of xinlian12 May 7, 2026 21:54 View session

Copilot AI reviewed May 7, 2026

View reviewed changes

xinlian12 changed the title ~~Add fabric-cosmos-spark-auth_4-0_2-13 for Spark 4.0 / Fabric Runtime 2.0~~ [NO REVIEW]Add fabric-cosmos-spark-auth_4-0_2-13 for Spark 4.0 / Fabric Runtime 2.0 May 7, 2026

xinlian12 and others added 2 commits May 7, 2026 15:04

fix: address PR review comments on README

4c4a9ce

- Fix doc links to point to azure-cosmos-spark_3/docs/ (existing location) - Fix grammar: 'signed-in user' -> 'a signed-in user' Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

fix: add fabric-cosmos-spark-auth_4-0_2-13 to cspell ignorePaths

2478584

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

FabianMeiswinkel approved these changes May 7, 2026

View reviewed changes

xinlian12 and others added 2 commits May 7, 2026 15:33

fix: update synapseutils_2.13 version to 1.6.2

57ba2de

synapseutils_2.13:1.5.4 does not exist on Maven Central. The earliest available version for the _2.13 variant is 1.6.2. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

xinlian12 changed the title ~~[NO REVIEW]Add fabric-cosmos-spark-auth_4-0_2-13 for Spark 4.0 / Fabric Runtime 2.0~~ Add fabric-cosmos-spark-auth_4-0_2-13 for Spark 4.0 / Fabric Runtime 2.0 May 8, 2026

xinlian12 commented May 8, 2026

View reviewed changes

Comment thread sdk/cosmos/fabric-cosmos-spark-auth_4-0_2-13/pom.xml

xinlian12 commented May 8, 2026

View reviewed changes

Comment thread sdk/cosmos/fabric-cosmos-spark-auth_4-0_2-13/README.md

Register fabric-cosmos-spark-auth_4-0_2-13 README in .docsettings.yml

e37d24a

Add the new module's README to known_content_issues to prevent CI doc validation failures, matching the existing fabric-cosmos-spark-auth_3 entry. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

xinlian12 requested review from raych1 and weshaggard as code owners May 8, 2026 18:42

xinlian12 requested a review from benbp as a code owner May 8, 2026 18:42

FabianMeiswinkel approved these changes May 8, 2026

View reviewed changes

alzimmermsft approved these changes May 8, 2026

View reviewed changes

weshaggard approved these changes May 8, 2026

View reviewed changes

xinlian12 merged commit 09053b7 into Azure:main May 8, 2026
46 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add fabric-cosmos-spark-auth_4-0_2-13 for Spark 4.0 / Fabric Runtime 2.0#49096

Add fabric-cosmos-spark-auth_4-0_2-13 for Spark 4.0 / Fabric Runtime 2.0#49096
xinlian12 merged 6 commits intoAzure:mainfrom
xinlian12:feat/issue-48884-fabric-cosmos-spark-auth-spark4

xinlian12 commented May 7, 2026

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

FabianMeiswinkel left a comment

Uh oh!

xinlian12 commented May 8, 2026

Uh oh!

Uh oh!

Uh oh!

xinlian12 commented May 8, 2026

Uh oh!

FabianMeiswinkel left a comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Conversation

xinlian12 commented May 7, 2026

Summary

What's New

Files Changed

Notes

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

FabianMeiswinkel left a comment

Choose a reason for hiding this comment

Uh oh!

xinlian12 commented May 8, 2026

Uh oh!

Uh oh!

Uh oh!

xinlian12 commented May 8, 2026

Uh oh!

FabianMeiswinkel left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants