Fix rollback in auto-commit mode and handle numeric autocommit responses

.github/ISSUE_TEMPLATE/bug_report.md

@@ -26,7 +26,7 @@ If available, share redacted client side logs
  - OS: [e.g. Windows]
  - Java version [e.g. Java 21]
  - Java vendor [e.g. OpenJDK]
- - Driver Version [e.g. 3.0.7]
+ - Driver Version [e.g. 3.1.1]
  - BI Tool (if used) [e.g. DBeaver]
  - BI Tool version (if applicable) [e.g. 24.3.5]
 

CHANGELOG.md

@@ -1,4 +1,18 @@
 # Version Changelog
+## [v3.1.1] - 2026-01-07
+
+### Added
+- Added token caching for all authentication providers to reduce token endpoint calls.
+- We will be rolling out the use of Databricks SQL Execution API by default for queries submitted on DBSQL. To continue using Databricks Thrift Server backend for execution, set `UseThriftClient` to `1`.
+
+### Updated
+- Changed default value of `IgnoreTransactions` from `0` to `1` to disable multi-statement transactions by default. Preview participants can opt-in by setting `IgnoreTransactions=0`. Also updated `supportsTransactions()` to respect this flag.
+
+### Fixed
+- [PECOBLR-1131] Fix incorrect refetching of expired CloudFetch links when using Thrift protocol.
+- Fixed logging to respect params when the driver is shaded.
+- Fixed `isWildcard` to return true only when the value is `*`
+
 ## [v3.0.7] - 2025-12-18
 
 ### Updated

NEXT_CHANGELOG.md

@@ -3,15 +3,27 @@
 ## [Unreleased]
 
 ### Added
-- Added token caching for all authentication providers to reduce token endpoint calls.
+- Added streaming prefetch mode for Thrift inline results (columnar and Arrow) with background batch prefetching and configurable sliding window for improved throughput.
+- Added `EnableInlineStreaming` connection parameter to enable/disable streaming mode (default: enabled).
+- Added `ThriftMaxBatchesInMemory` connection parameter to control the sliding window size for streaming (default: 3).
+- Added support for disabling CloudFetch via `EnableQueryResultDownload=0` to use inline Arrow results instead.
+- Added `EnableMetricViewSupport` connection parameter to enable/disable Metric View table type (default: disabled).
+- Added `NonRowcountQueryPrefixes` connection parameter to specify comma-separated query prefixes that should return result sets instead of row counts.
 
 ### Updated
+- Enhanced error logging for token exchange failures.
+- Geospatial column type names now include SRID information (e.g., `GEOMETRY(4326)` instead of `GEOMETRY`).
+- Changed default value of `IgnoreTransactions` from `0` to `1` to disable multi-statement transactions by default. Preview participants can opt-in by setting `IgnoreTransactions=0`. Also updated `supportsTransactions()` to respect this flag.
+- Implemented lazy loading for inline Arrow results, fetching arrow batches on demand instead of all at once. This improves memory usage and initial response time for large result sets when using the Thrift protocol with Arrow format.
+- **Enhanced `enableMultipleCatalogSupport` behavior**: When this parameter is disabled (`enableMultipleCatalogSupport=0`), metadata operations (such as `getSchemas()`, `getTables()`, `getColumns()`, etc.) now return results only when the catalog parameter is either `null` or matches the current catalog. For any other catalog name, an empty result set is returned. This ensures metadata queries are restricted to the current catalog context. When enabled (`enableMultipleCatalogSupport=1`), metadata operations continue to work across all accessible catalogs.
 
 ### Fixed
-
-- [PECOBLR-1131] Fix incorrect refetching of expired CloudFetch links when using Thrift protocol.
-- Fixed logging to respect params when the driver is shaded.
-- Fixed `isWildcard` to return true only when the value is `*`
+- Fixed timeout exception handling to throw `SQLTimeoutException` instead of `DatabricksHttpException` when queries timeout during result fetching phase. This completes the timeout exception fix to handle both query execution polling and result fetching phases.
+- Fixed `getTypeInfo()` and `getClientInfoProperties()` to return fresh ResultSet instances on each call instead of shared static instances. This resolves issues where calling these methods multiple times would fail due to exhausted cursor state (Issue #1178).
+- Fixed complex data type metadata support when retrieving 0 rows in Arrow format
+- Normalized TIMESTAMP_NTZ to TIMESTAMP in Thrift path for consistency with SEA behavior
+- Fixed complex types not being returned as objects in SEA Inline mode when `EnableComplexDatatypeSupport=true`.
+- Fixed `StringIndexOutOfBoundsException` when parsing complex data types in Thrift CloudFetch mode. The issue occurred when metadata contained incomplete type information (e.g., "ARRAY" instead of "ARRAY<INT>"). Now retrieves complete type information from Arrow metadata.
 
 ---
 *Note: When making changes, please add your change under the appropriate section

README.md

@@ -20,7 +20,7 @@ Add the following dependency to your `pom.xml`:
 <dependency>
   <groupId>com.databricks</groupId>
   <artifactId>databricks-jdbc</artifactId>
-  <version>3.0.7</version>
+  <version>3.1.1</version>
 </dependency>
 ```
 

development/.release-freeze.json

@@ -1,4 +1,4 @@
 {
-  "freeze": false,
-  "reason": "Release freeze disabled"
+  "freeze": true,
+  "reason": "Release version 3.2.1"
 }

pom.xml

@@ -5,7 +5,7 @@
   <groupId>com.databricks</groupId>
   <artifactId>databricks-jdbc</artifactId>
   <!-- This value may be modified by a release script to reflect the current version of the driver. -->
-  <version>3.0.7</version>
+  <version>3.1.1</version>
   <packaging>jar</packaging>
   <name>Databricks JDBC Driver</name>
   <description>Databricks JDBC Driver.</description>

release-notes.txt

@@ -6,6 +6,21 @@ The release notes summarize enhancements, new features, known issues, workflow c
 
 Version History ==============================================================
 
+3.1.1 ========================================================================
+Released 2026-01-07
+
+Enhancements & New Features
+
+ * Added token caching for all authentication providers to reduce token endpoint calls.
+ * We will be rolling out the use of Databricks SQL Execution API by default for queries submitted on DBSQL. To continue using Databricks Thrift Server backend for execution, set `UseThriftClient` to `1`.
+ * Changed default value of `IgnoreTransactions` from `0` to `1` to disable multi-statement transactions by default. Preview participants can opt-in by setting `IgnoreTransactions=0`. Also updated `supportsTransactions()` to respect this flag.
+
+Resolved Issues
+
+ * [PECOBLR-1131] Fix incorrect refetching of expired CloudFetch links when using Thrift protocol.
+ * Fixed logging to respect params when the driver is shaded.
+ * Fixed `isWildcard` to return true only when the value is `*`
+
 3.0.7 ========================================================================
 Released 2025-12-18
 

src/main/java/com/databricks/client/jdbc/DataSource.java

@@ -4,7 +4,6 @@
 
 import com.databricks.jdbc.common.DatabricksJdbcConstants;
 import com.databricks.jdbc.common.DatabricksJdbcUrlParams;
-import com.databricks.jdbc.exception.DatabricksSQLException;
 import com.databricks.jdbc.log.JdbcLogger;
 import com.databricks.jdbc.log.JdbcLoggerFactory;
 import com.databricks.jdbc.pooling.DatabricksPooledConnection;
@@ -37,13 +36,13 @@ public DataSource(Driver driver) {
   }
 
   @Override
-  public Connection getConnection() throws DatabricksSQLException {
+  public Connection getConnection() throws SQLException {
     LOGGER.debug("public Connection getConnection()");
     return getConnection(this.getUsername(), this.getPassword());
   }
 
   @Override
-  public Connection getConnection(String username, String password) throws DatabricksSQLException {
+  public Connection getConnection(String username, String password) throws SQLException {
     LOGGER.debug("public Connection getConnection(String, String)");
     if (username != null) {
       setUsername(username);
@@ -55,14 +54,13 @@ public Connection getConnection(String username, String password) throws Databri
   }
 
   @Override
-  public PooledConnection getPooledConnection() throws DatabricksSQLException {
+  public PooledConnection getPooledConnection() throws SQLException {
     LOGGER.debug("public PooledConnection getPooledConnection()");
     return new DatabricksPooledConnection(getConnection());
   }
 
   @Override
-  public PooledConnection getPooledConnection(String user, String password)
-      throws DatabricksSQLException {
+  public PooledConnection getPooledConnection(String user, String password) throws SQLException {
     LOGGER.debug("public PooledConnection getPooledConnection(String, String)");
     return new DatabricksPooledConnection(getConnection(user, password));
   }

src/main/java/com/databricks/client/jdbc/Driver.java

@@ -47,7 +47,7 @@ public boolean acceptsURL(String url) {
   }
 
   @Override
-  public Connection connect(String url, Properties info) throws DatabricksSQLException {
+  public Connection connect(String url, Properties info) throws SQLException {
     if (!acceptsURL(url)) {
       // Return null connection if URL is not accepted - as per JDBC standard.
       return null;

src/main/java/com/databricks/jdbc/api/impl/DatabricksConnection.java

@@ -63,7 +63,7 @@ public DatabricksConnection(
   }
 
   @Override
-  public void open() throws DatabricksSQLException {
+  public void open() throws SQLException {
     this.session.open();
   }
 
@@ -252,13 +252,13 @@ private boolean fetchAutoCommitStateFromServer() throws SQLException {
       ResultSet rs = statement.executeQuery("SET AUTOCOMMIT");
 
       if (rs.next()) {
-        // The result should contain the value = "true" or "false"
+        // The result may contain "true"/"false" or "1"/"0" depending on the server
         String value = rs.getString(1); // Column 1: value
 
         LOGGER.debug(
             "Fetched autoCommit state from server: value={}. Updating session cache.", value);
 
-        boolean autoCommitState = "true".equalsIgnoreCase(value);
+        boolean autoCommitState = "true".equalsIgnoreCase(value) || "1".equals(value);
 
         // Update the session cache with the server value
         session.setAutoCommit(autoCommitState);
@@ -382,13 +382,20 @@ public void rollback() throws SQLException {
       return;
     }
 
+    // Rollback is not valid when auto-commit is enabled (no active transaction)
+    if (getAutoCommit()) {
+      throw new DatabricksTransactionException(
+          "Cannot use rollback while Connection is in auto-commit mode.",
+          new SQLException("Cannot use rollback while Connection is in auto-commit mode."),
+          DatabricksDriverErrorCode.TRANSACTION_ROLLBACK_ERROR);
+    }
+
     // Execute ROLLBACK command
     Statement statement = null;
     try {
       statement = createStatement();
       statement.execute("ROLLBACK");
       // Note: Server auto-starts new transaction if autocommit=false
-      // Note: ROLLBACK is more forgiving - typically succeeds even on unexpected states
 
     } catch (SQLException e) {
       LOGGER.error(e, "Error {} while rolling back transaction", e.getMessage());
@@ -401,7 +408,7 @@ public void rollback() throws SQLException {
   }
 
   @Override
-  public void close() throws DatabricksSQLException {
+  public void close() throws SQLException {
     LOGGER.debug("public void close()");
     for (IDatabricksStatementInternal statement : statementSet) {
       statement.close(false);

src/main/java/com/databricks/jdbc/api/impl/DatabricksConnectionContext.java

@@ -457,7 +457,7 @@ public DatabricksClientType getClientTypeFromContext() {
     // Check if circuit breaker is open due to recent 429 rate limit failures
     if (SeaCircuitBreakerManager.isCircuitOpen()) {
       long remainingMs = SeaCircuitBreakerManager.getTimeRemainingMs();
-      LOGGER.info(
+      LOGGER.debug(
           "SEA circuit breaker is OPEN due to recent 429 rate limit failures. "
               + "Using THRIFT client. Circuit will close in {} ({}ms)",
           SeaCircuitBreakerManager.getTimeRemainingFormatted(),
@@ -469,7 +469,7 @@ public DatabricksClientType getClientTypeFromContext() {
       return DatabricksClientType.THRIFT;
     }
     // Check if CloudFetch is disabled - Thrift is required for inline mode
-    if (!Objects.equals(getParameter(DatabricksJdbcUrlParams.ENABLE_CLOUD_FETCH), "1")) {
+    if (!isCloudFetchEnabled()) {
       return DatabricksClientType.THRIFT;
     }
     // Check feature flag to determine if SEA client should be enabled
@@ -1162,9 +1162,19 @@ public boolean isBatchedInsertsEnabled() {
     return getParameter(DatabricksJdbcUrlParams.ENABLE_BATCHED_INSERTS).equals("1");
   }
 
+  @Override
+  public List<String> getNonRowcountQueryPrefixes() {
+    String prefixesStr = getParameter(DatabricksJdbcUrlParams.NON_ROWCOUNT_QUERY_PREFIXES);
+    return Arrays.stream(prefixesStr.split(","))
+        .map(String::trim)
+        .map(String::toUpperCase)
+        .filter(s -> !s.isEmpty())
+        .collect(Collectors.toList());
+  }
+
   @Override
   public boolean getIgnoreTransactions() {
-    return getParameter(DatabricksJdbcUrlParams.IGNORE_TRANSACTIONS, "0").equals("1");
+    return getParameter(DatabricksJdbcUrlParams.IGNORE_TRANSACTIONS).equals("1");
   }
 
   @Override
@@ -1198,6 +1208,27 @@ public boolean isStreamingChunkProviderEnabled() {
     return getParameter(DatabricksJdbcUrlParams.ENABLE_STREAMING_CHUNK_PROVIDER).equals("1");
   }
 
+  @Override
+  public boolean isInlineStreamingEnabled() {
+    return getParameter(DatabricksJdbcUrlParams.ENABLE_INLINE_STREAMING).equals("1");
+  }
+
+  @Override
+  public boolean isCloudFetchEnabled() {
+    return getParameter(DatabricksJdbcUrlParams.ENABLE_CLOUD_FETCH).equals("1");
+  }
+
+  @Override
+  public int getThriftMaxBatchesInMemory() {
+    try {
+      return Integer.parseInt(getParameter(DatabricksJdbcUrlParams.THRIFT_MAX_BATCHES_IN_MEMORY));
+    } catch (NumberFormatException e) {
+      LOGGER.warn("Invalid value for ThriftMaxBatchesInMemory, using default value");
+      return Integer.parseInt(
+          DatabricksJdbcUrlParams.THRIFT_MAX_BATCHES_IN_MEMORY.getDefaultValue());
+    }
+  }
+
   @Override
   public int getLinkPrefetchWindow() {
     return Integer.parseInt(getParameter(DatabricksJdbcUrlParams.LINK_PREFETCH_WINDOW));

src/main/java/com/databricks/jdbc/api/impl/DatabricksDatabaseMetaData.java

@@ -2,7 +2,6 @@
 
 import static com.databricks.jdbc.common.MetadataResultConstants.*;
 import static com.databricks.jdbc.dbclient.impl.common.CommandConstants.METADATA_STATEMENT_ID;
-import static com.databricks.jdbc.dbclient.impl.sqlexec.ResultConstants.CLIENT_INFO_PROPERTIES_RESULT;
 
 import com.databricks.jdbc.api.impl.converters.ConverterHelper;
 import com.databricks.jdbc.api.internal.IDatabricksConnectionInternal;
@@ -834,7 +833,7 @@ public int getDefaultTransactionIsolation() throws SQLException {
   public boolean supportsTransactions() throws SQLException {
     LOGGER.debug("public boolean supportsTransactions()");
     throwExceptionIfConnectionIsClosed();
-    return true;
+    return !session.getConnectionContext().getIgnoreTransactions();
   }
 
   @Override
@@ -1529,7 +1528,7 @@ public boolean autoCommitFailureClosesAllResultSets() throws SQLException {
   public ResultSet getClientInfoProperties() throws SQLException {
     LOGGER.debug("public ResultSet getClientInfoProperties()");
     throwExceptionIfConnectionIsClosed();
-    return CLIENT_INFO_PROPERTIES_RESULT;
+    return metadataResultSetBuilder.getClientInfoPropertiesResult();
   }
 
   @Override

src/main/java/com/databricks/jdbc/api/impl/DatabricksPreparedStatement.java

@@ -339,7 +339,7 @@ public boolean execute() throws SQLException {
     checkIfClosed();
     checkIfBatchOperation();
     interpolateIfRequiredAndExecute(StatementType.SQL);
-    return shouldReturnResultSet(sql);
+    return shouldReturnResultSetWithConfig(sql);
   }
 
   @Override