Connect to Turbot Pipes from DBT

DBT is a SQL-first IDE to query, edit and manage your databases.

Steampipe provides a single interface to all your cloud, code, logs and more. Because it's built on Postgres, Steampipe provides an endpoint that any Postgres-compatible client -- including DBT -- can connect to.

You can get the information needed to connect to your Turbot Pipes database instance from the Query tab for your workspace. On the Query tab, click the info button at the top of the query window to show the connection information.

Once the connection to Turbot Pipes is established and tested, you can explore the Steampipe plugins, run queries and build reports.

You can also connect DBT to Steampipe CLI. To do that, run steampipe service start --show-password and use the displayed connection details.

Steampipe service is running:

Database:

  Host(s):            localhost, 127.0.0.1, 192.168.29.204
  Port:               9193
  Database:           steampipe
  User:               steampipe
  Password:           99**_****_**8c
  Connection string:  postgres://steampipe:99**_****_**8c@localhost:9193/steampipe

Getting started

[DBT is available to use on the desktop and the cloud. To use it, create an account and select a DBT cloud plan -- here we use the free developer plan. In this example we will create a Turbot Pipes connection from DBT and query the top stories by score from hackernews_top.

Since DBT projects include version control, it requires linking your git repository with write access enabled through linked accounts under account settings. Next, Select PostgreSQL under Credentials to create a new connection and enter the Turbot Pipes connection details, click Test Connection to Verify.

Once you've connected to Turbot Pipes, paste this query and click compile. DBT then previews the data in a table form which can also be saved in a .csv file.

select
  *
from
  hackernews_top
order by
  score desc