Native integration
Databricks
Run SQL queries and manage jobs on Databricks
Connect to Databricks to execute SQL queries against SQL warehouses, trigger and monitor job runs, manage clusters, and retrieve run outputs. Requires a Personal Access Token and workspace host URL.
What teams can do
Move from signal to action.
Combine Databricks with reasoning, approvals, data, and every other SteelEngine block. The result is one governed workflow rather than another brittle handoff.
Give agents governed data access
Keep systems synchronized and observable
Connection path
From account to production in three moves.
SteelEngine keeps credentials encrypted and the workflow visible. Add Databricks, choose the capabilities an agent can use, and ship with the controls your team requires.
Authorize Databricks
Connect with api key and keep credentials out of workflow logic.
Choose actions and triggers
Use fixed workflow steps, expose selected actions to an agent, or combine both.
Add production guardrails
Apply approvals, permissions, retries, schedules, and an audit trail before deployment.
Supported capabilities
8 ways to work with Databricks.
Capabilities are available as workflow blocks and can be selectively exposed to agents. Exact configuration and permission requirements are documented for each action.
Execute SQL
Execute a SQL statement against a Databricks SQL warehouse and return results inline. Supports parameterized queries and Unity Catalog.
List Jobs
List all jobs in a Databricks workspace with optional filtering by name.
Run Job
Trigger an existing Databricks job to run immediately with optional job-level or notebook parameters.
Get Run
Get the status, timing, and details of a Databricks job run by its run ID.
List Runs
List job runs in a Databricks workspace with optional filtering by job, status, and time range.
Cancel Run
Cancel a running or pending Databricks job run. Cancellation is asynchronous; poll the run status to confirm termination.
Get Run Output
Get the output of a completed Databricks job run, including notebook results, error messages, and logs. For multi-task jobs, use the task run ID (not the parent run ID).
List Clusters
List all clusters in a Databricks workspace including their state, configuration, and resource details.
Build with Databricks
Put the connection to work.
Start with a real operational workflow. SteelEngine’s team can help map the systems, controls, and deployment path.