fix: Remove external path on intermediate tables for python incremental models (#1161)

<!-- Please review our pull request review process in CONTRIBUTING.md
before your proceed. -->


<!---
Include the number of the issue addressed by this PR above if
applicable.

  Example:
    resolves #1234

Please review our pull request review process in CONTRIBUTING.md before
your proceed.
-->

### Description
This update changes how intermediate tables are handled for Python
incremental models (with Materialization V2). Previously, when Python
models were configured to save as external tables, their intermediate
tables were also stored in the external path. This caused two main
issues:

- Concurrency problems: Even when using unique_tmp_table_suffix=True,
all runs shared the same external path, leading to conflicts.
- Unnecessary storage: Data from intermediate tables was not deleted
when the tables were dropped, leaving unwanted files in the storage
account.

With this change, intermediate tables will be stored as managed tables,
which will:

- Prevent concurrency issues by ensuring each run uses a unique
location.
- Automatically remove intermediate data after dbt execution, keeping
storage clean and efficient.

<!--- Describe the Pull Request here -->

### Checklist

- [x] I have run this code in development and it appears to resolve the
stated issue
- [x] This PR includes tests, or tests are not required/relevant for
this PR
- [x] I have updated the `CHANGELOG.md` and added information about my
change to the "dbt-databricks next" section.

---------

Co-authored-by: Ben Cassell <98852248+benc-db@users.noreply.github.com>

Author: gsolasab

CHANGELOG.md

@@ -3,6 +3,7 @@
 ### Fixes
 
 - Improve ANSI mode error handling for Python models and add debug instrumentation ([1157](https://github.com/databricks/dbt-databricks/pull/1157))
+- Remove external path on intermediate tables for incremental models (with Materialization V2) ([1161](https://github.com/databricks/dbt-databricks/pull/1161))
 
 ## dbt-databricks 1.10.10 (August 20, 2025)
 

dbt/include/databricks/macros/adapters/python.sql

@@ -111,7 +111,6 @@ except ImportError:
 {% macro create_python_intermediate_table(relation, compiled_code) %}
 {{ compiled_code }}
 
-{%- set location_root = config.get('location_root', validator=validation.any[basestring]) -%}
 {%- set file_format = config.get('file_format', validator=validation.any[basestring])|default('delta', true) -%}
 
 # --- Autogenerated dbt materialization code. --- #
@@ -171,11 +170,7 @@ writer = (
         .mode("overwrite")
         .option("overwriteSchema", "true")
         .format("{{ file_format }}")
-{%- if location_root is not none -%}
-{%- set model_path = adapter.compute_external_path(config, model, True) %}
-        .option("path", "{{ model_path }}")
-{%- endif -%}
 )
 
 writer.saveAsTable("{{ relation.render() }}")
-{% endmacro %}
+{% endmacro %}