Support saved query in SQL datawarehouse ? about databricks-sql-python HOT 5 CLOSED

Spark SQL doesn't support saved queries / stored procedures. Therefore it's impossible with our connector.

The connector can run multi-statement queries; but only if you pass it the complete text of the query + any parameters. Spark SQL has no way to save these by name.

from databricks-sql-python.

Instead, these procedures could be stored as functions in whatever tool you use to make the calls.

In DBT for example, you could use macros (with parameters) or custom materializations (with variables).

from databricks-sql-python.

Exactly @mroy-seedbox. With Databricks workflows you can use sql task as workflow objects too, which is a similar idea.

from databricks-sql-python.

Instead, these procedures could be stored as functions in whatever tool you use to make the calls.

In DBT for example, you could use macros (with parameters) or custom materializations (with variables).

great, I tested the function and it works

cursor.execute("SELECT * FROM db.fn_dnl_act_pay_dt(%(parm1)s, %(parm2)s, %(parm3)s);", {"parm1": "abc", "parm2": "bcd", "parm3": "fgh"})

only issue is I need must add database name before the table name, or it will fail.
Exception has occurred: ServerOperationError
Table or view not found:

use view does not require add database name before table name

from databricks-sql-python.

Exactly @mroy-seedbox. With Databricks workflows you can use sql task as workflow objects too, which is a similar idea.

you mean dbt task? SQL task is not available from drop down

SORRY, IGNORE, THE FEATURE IS STILL IN PRIVATE PREVIEW

from databricks-sql-python.