Changelog

Custom tenant and organization member pages now allow for creation and management of service accounts. Service accounts are a specialized type of user designed for programmatic access to Turbot Pipes.

For more information, check out the tenant or organization member docs.

v0.16.0 of the Terraform Provider for Pipes is now available.

What's new?

• Updated hashicorp/terraform-plugin-sdk to v2.37.0
• Updated go-kit to v1.3.0

Enhancements

• The following resources now support write-only configuration with new config_wo and config_wo_version arguments
  • resources/pipes_connection
  • resources/pipes_organization_connection
  • resources/pipes_tenant_connection
  • resources/pipes_workspace_connection
  • resources/pipes_organization_integration
  • resources/pipes_tenant_integration
  • resources/pipes_user_integration

v0.15.3 of the Terraform Provider for Pipes is now available.

What's new?

• Updated pipes-sdk-go to v0.15.0.
• New Resource: pipes_tenant_settings

Enhancements

• resources/pipes_connection: Added attributes status, last_error_at, last_error_process_id, last_successful_update_at, last_successful_update_process_id, last_update_attempt_at, last_update_attempt_process_id.
• resources/pipes_organization_connection: Added attributes status, last_error_at, last_error_process_id, last_successful_update_at, last_successful_update_process_id, last_update_attempt_at, last_update_attempt_process_id.
• resources/pipes_tenant: Added attribute token_min_issued_at.
• resources/pipes_tenant_connection: Added attributes status, last_error_at, last_error_process_id, last_successful_update_at, last_successful_update_process_id, last_update_attempt_at, last_update_attempt_process_id.
• resources/pipes_workspace_connection: Added attributes status, last_error_at, last_error_process_id, last_successful_update_at, last_successful_update_process_id, last_update_attempt_at, last_update_attempt_process_id.

v0.15.0 of the Pipes SDK Go is now available.

Enhancements

• Added extra attributes to Connection to support Status, LastErrorAt, LastErrorProcessId, LastSuccessfulUpdateAt, LastSuccessfulUpdateProcessId, LastUpdateAttemptAt and LastUpdateAttemptProcessId to track the connection status and last update attempts.
• Added extra attributes to WorkspaceConnection to support Status, LastErrorAt, LastErrorProcessId, LastSuccessfulUpdateAt, LastSuccessfulUpdateProcessId, LastUpdateAttemptAt and LastUpdateAttemptProcessId to track the connection status and last update attempts.
• Added ConnectionId attribute to SpProcess to track the connection associated with a process.
• Added TokenMinIssuedAt attribute to Tenant to determine the time after which tokens will be accepted for this tenant.
• Added extra attributes to TenantSettings to support MaxTokenExpiration, CliSessionTimeout, ConsoleSessionTimeout and PostgresEnabled to manage tenant settings around timeouts, tokens and direct database access.
• Added extra attributes to Token to support CreatedBy, CreatedById, UpdatedBy, UpdatedById, ExpiresAt, Title, Description and TokenType to provide more context and control over tokens.
• Added BillingMode attribute to UsageMetric to denote the billing mode for the metric.

What's new?

• Added ConnectionStatus enum to represent the status of a connection.
• Added PostgresEndpointState enum to represent the state of the Postgres endpoint.
• Added UsageBillingModeType enum to represent the billing mode for usage metrics.

Enterprise plan now has tenant settings allowing owners to control direct access to Steampipe PostgreSQL endpoints.

For more information, check out the docs

Users can now create up to five tokens. You can also set an expiration for each token and optionally add a title to make them easier to identify in your token list.

For enterprise plan customers, we've introduced a new Maximum Token Expiration tenant setting. This lets you control the maximum lifespan of tokens created within your tenant.

For more information, check out the docs

Custom tenant settings now allow owners to control session timeouts for Console (browser) and CLI logins.

For more information, check out the docs

v0.15.2 of the Terraform Provider for Pipes is now available.

Bug Fixes

• Updated pipes-sdk-go to v0.14.0.
• Support for creation of db1.medium workspace instance types.

v0.15.1 of the Terraform Provider for Pipes is now available.

Bug Fixes

• Resource pipes_tenant_connection: Attribute config should store data from the response object.
• Resource pipes_organization_connection: Attribute config should store data from the response object.
• Resource pipes_workspace_connection: Attribute config should store data from the response object.

v0.14.0 of the Pipes SDK Go is now available.

Enhancements

• Add db1.medium as a new supported workspace instance type.
• Add PersonalWorkspaces as a new tenant setting to block / allow creation of personal workspaces in a custom tenant.

Switch between different workspace instance types to adjust your workspace configuration to better match your workload requirements. Whether you're optimizing for performance or cost, you can choose the instance type that best fits your needs.

For more information, check out the docs.

Persistent workspaces now support a new instance type: db1.medium. This instance type is ideal for larger workloads, including datatanks with multiple tables containing hundreds of partitions.

We've also improved the workspace creation experience. You can now view all available instance types more easily and set the DB volume size during creation, with clear limits outlined for each type.

For more information, check out the docs.

Custom tenant settings now allow owners to manage personal workspaces for users. This includes the ability to enable or disable the creation of personal workspaces.

For more information, check out the docs.

Enhancements to the user experience for creating an AWS integration through Pipes to make it quicker and simpler to import your accounts.

For more information, check out the docs.

v0.13.0 of the Pipes SDK Go is now available.

Breaking changes

• Get_1 method in UserWorkspaceSchemasService used to list tables for a schema renamed to ListTables to denote its exact purpose.
• Get_1 method in OrgWorkspaceSchemasService used to list tables for a schema renamed to ListTables to denote its exact purpose.

What's new?

• Add support for GetTable method to UserWorkspaceSchemasService to get a specific table for a schema.
• Add support for GetTable method to OrgWorkspaceSchemasService to get a specific table for a schema.

Enhancements

• Install and Update for both flowpipe and powerpipe mods now support archived mod upload via multipart/form-data request.
• Add SourceType to model WorkspaceMod to denote the source of the mod i.e. repository or archive.
• Add AggregatedBy to model WorkspaceSchema to store the list of aggregators that are using the schema.

Turbot Pipes' latest update enhances its built-in query editor with improved schema navigation, integrated documentation, pre-built query examples, and powerful search, making it faster and easier for teams to explore and query cloud data.

For more information on this release, see the blog post or refer to the documentation.

All Pipes workspaces are now running Steampipe v1.1.0.

For more information on this Steampipe release, see the release notes.

The schema list view in the Steampipe query editor now hides aggregated connections by default. This change helps highlight the key schemas whilst also improving readability of the list, especially in workspaces with a large number of aggregated connections.

You can still view the aggregated connections by clicking the Show Aggregated Connections option via the schema list settings button. This will expand the list to show all connections, including the aggregated ones.

Persistent workspaces now support high-performance SSD storage. This allows you to run your workloads on faster storage, which can be especially useful for queries that require high IOPS or low latency.

Any new persistent workspaces created will automatically use SSD storage. We'll gradually migrate existing persistent workspaces to SSD storage over the next few weeks. This change is included in the current pricing model and will not incur any additional cost.

Powerpipe and Flowpipe services in Pipes now support installing mods from an archive file.

For more information, check out the respective docs for Powerpipe or Flowpipe.

Enhancements:

• The maximum amount of rows that can be fetched via the query API has been increased from 5,000 to 25,000, allowing users to retrieve more data in a single request.
• Any query executed via the API that ran for 2 minutes prior to this change would be timed out and no data would be returned. The query API will now return all data fetched up to that point if the 2 minute limit is reached.
• Any timed out query API responses that contain data will now have a 206 (Partial Content) status, with 408 (Request Timeout) still being the status for any requests that have timed out with no data.

All Pipes workspaces are now running Powerpipe v1.2.0.

For more information on this Powerpipe release, see the release notes.

v0.15.0 of the Terraform Provider for Pipes is now available.

Breaking Changes

• Attribute github_installation_id for resource pipes_tenant_integration is now of type int instead of string.
• Attribute github_installation_id for resource pipes_organization_integration is now of type int instead of string.
• Attribute github_installation_id for resource pipes_user_integration is now of type int instead of string.

What's new?

• Data Source pipes_organization_integration.
• Data Source pipes_tenant_integration.
• Data Source pipes_user_integration.
• Data Source pipes_workspace.
• Data Source pipes_workspace_flowpipe_pipeline.
• Resource pipes_tenant_notifier.
• Resource pipes_organization_notifier.
• Resource pipes_user_notifier.
• Resource pipes_workspace_notifier.
• Resource pipes_workspace_flowpipe_mod.
• Resource pipes_workspace_flowpipe_mod_variable.
• Resource pipes_workspace_flowpipe_trigger.

Enhancements

• Add last_activity_at attribute to the pipes_tenant_member resource to track the last time a user performed an activity in the tenant.
• Add last_activity_at attribute to the pipes_organization_member resource to track the last time a user performed an activity in the organization.
• Add last_activity_at attribute to the pipes_organization_workspace_member resource to track the last time a user performed an activity in the workspace.

Integrate your developer account, team or custom tenant with GitLab, enabling you to install custom Powerpipe or Flowpipe mods from public or private projects. Push changes for instant deploys and live updates.

For more information, check out the docs.

All Pipes workspaces are now running Powerpipe v1.1.0.

For more information on this Powerpipe release, see the release notes.

Custom tenant, organization and workspace people pages now show the last activity date for each member, allowing owners to track usage of their environments.

For more information, check out the tenant, organization and workspace people docs.

Custom tenant settings now allow owners to control workspace snapshot visibility settings, restricting the use of publicly-shared snapshot links.

For more information, check out the docs.

The Okta plugin in Pipes now supports max_backoff, max_retries and request_timeout settings.

To get started, create an Okta connection and add it to your workspace.

All Pipes workspaces are now running Steampipe v1.0.0.

For more information on this Steampipe release, see the launch post or check out the release notes.

All Pipes workspaces are now running Powerpipe v1.0.0.

For more information on this Powerpipe release, see the launch post or check out the release notes.

With a web UI, point-and-click mod installation, and easy integration with Slack and GitHub, Pipes takes workflows-as-code to the next level.

For more information, see the launch post or check out the docs.

All the components of Turbot's open source suite are now fully integrated into Pipes.

For more information, see the launch post or check out the docs.

The Prisma Cloud plugin is now available in all Pipes workspaces.

To get started, create a connection and add it to your workspace.

All Pipes workspaces are now running Steampipe v0.24.0.

For more information on this Steampipe release, see the release notes.

GCP integrations now make use of temporary credentials via service account impersonation using the Service Account Token Creator role.

For more information, check out the docs.

v0.14.0 of the Terraform Provider for Pipes is now available.

Breaking Changes

• Functionality for resource resources/pipes_workspace_connection moved to manage connections at the workspace level. Previously, the resource used to manage attachment of connections to the workspace defined at the respective identity level. Please follow the migration guide for migrating your existing configuration into the new model.
• Resource resources/pipes_connection does not support management of user level connections in line with changes in Pipes.

What's new?

• Resource pipes_organization_connection
• Resource pipes_organization_connection_folder
• Resource pipes_organization_connection_folder_permission
• Resource pipes_organization_connection_permission
• Resource pipes_organization_integration
• Resource pipes_tenant_connection
• Resource pipes_tenant_connection_folder
• Resource pipes_tenant_connection_folder_permission
• Resource pipes_tenant_connection_permission
• Resource pipes_tenant_integration
• Resource pipes_user_integration
• Resource pipes_workspace_connection_folder
• Resource pipes_workspace_schema

Enhancements

• Resource resources/pipes_workspace_mod add support for storing attribute state_reason

v0.10.0 of the Pipes SDK Go is now available.

What's new?

• Intregation Management APIs for Tenants, Users, Organizations, UserWorkspaces and OrgWorkspaces.
• Tenant Connection Management APIs.
• Tenant Connection Folder Management APIs.
• User Connection Folder Management APIs.
• Organization Connection Management APIs.
• Organization Connection Folder Management APIs.
• Workspace Connection Management APIs.
• Workspace Connection Folder Management APIs.
• Permission Management APIs for Connections and ConnectionFolders.

Enhancements

• Add support for installing mods that are associated to integrations.
• Add support for setting search path prefix for a workspace.

Import a tree of folders and projects as Pipes connections, control permissions for workspaces, and auto-create aggregators.

For more information, see the launch post or check out the docs.

You can now create connections at the custom tenant, organization or workspace level in Pipes, along with grouping of these within folders to allow easier sharing of related connections.

This is coupled with a fine-grained permissions model, allowing you to share connections & folders broadly across a custom tenant, or restrict access to specific organizations and/or their workspaces.

For more information, check out the docs:

• Tenant connections
• Org connections
• Workspace connections

Import a tree of management groups and subscriptions as Pipes connections, control permissions for workspaces, and auto-create aggregators.

For more information, see the launch post or check out the docs.

Import a tree of OUs and accounts as Pipes connections, control permissions for workspaces, and auto-create aggregators.

For more information, see the launch post or check out the docs.

The CrowdStrike plugin is now available in all Pipes workspaces.

To get started, create a connection and add it to your workspace.

All Pipes workspaces are now running Steampipe v0.23.2.

For more information on this Steampipe release, see the release notes.

All Pipes workspaces are now running Powerpipe v0.4.0.

For more information on this Powerpipe release, see the release notes.

The Semgrep plugin is now available in all Pipes workspaces.

To get started, create a connection and add it to your workspace.

Integrate your developer account, team or custom tenant with GitHub, enabling you to install custom Powerpipe mods from public or private repositories. Push changes for instant deploys and live updates.

For more information, see the launch post or check out the docs.

All new Pipes workspaces will be running Powerpipe v0.2.0 and existing workspaces will be upgraded by Monday 29th April 2024.

For more information on this Powerpipe release, see the release notes.

v0.13.2 of the Terraform Provider for Pipes is now available.

Bug fixes

• pipes_workspace_datatank_table: Set PartPer setting for datatank table to be nil if nothing is passed in configuration while updating a datatank table. (#23)

Enhancements:

• resources/pipes_workspace: Add support for passing desired_state, db_volume_size_bytes attribute when creating or updating a workspace. Add missing attribute state_reason.
• resources/pipes_workspace_pipeline: Add support for passing desired_state attribute when creating or updating a pipeline. Add attributes state and state_reason.
• resources/pipes_workspace_datatank: Add support for passing desired_state attribute when creating a datatank.
• resources/pipes_workspace_datatank_table: Add support for passing desired_state attribute when creating a datatank_table.

All new Pipes workspaces will be running Powerpipe v0.4.1 and existing workspaces will be upgraded by Monday 29th July 2024.

For more information on this Powerpipe release, see the release notes.

All new Pipes workspaces will be running Steampipe v0.22.1 and existing workspaces will be upgraded by Monday 18th March 2024.

For more information on this Steampipe release, see the release notes.

All new Pipes workspaces will be running Powerpipe v0.1.2 and existing workspaces will be upgraded by Monday 18th March 2024.

For more information on this Powerpipe release, see the release notes.

v0.13.1 of the Terraform Provider for Pipes is now available.

Bug fixes

• Ensure tags are passed during creation of resource pipes_workspace_pipeline and are only updated when a valid value is present in the Terraform configuration.

All new Pipes workspaces will be running Steampipe v0.22.0 and existing workspaces will be upgraded by Monday 11th March 2024.

For more information on this Steampipe release, see the release post or release notes.

Dashboards in Turbot Pipes are now powered by Powerpipe, allowing you to filter, group and share custom views of your cloud benchmarks.

All new Pipes workspaces will be running Powerpipe v0.1.0 and existing workspaces will be upgraded by Monday 11th March 2024.

For more information on the launch of Powerpipe, see the launch post or release notes.

The timeout for scheduled snapshot pipelines has been extended from 10 minutes to 1 hour, giving complex benchmarks and dashboards longer to successfully complete.

v0.13.0 of the Terraform Provider for Pipes is now available.

What's new?

• Data Source pipes_tenant.
• Resource pipes_tenant_member.

Enhancements

• Resource pipes_organization_member now supports adding users directly to an organization in a custom tenant, rather than by invitation.

v0.12.1 of the Terraform Provider for Pipes is now available.

Bug fixes

• Omitting the PartPer setting for a pipes_workspace_datatank_table resource would have previously resulted in an error, meaning you had to pass connection as the value. This field is now optional, allowing single part tables to be defined.

Turbot Pipes Enterprise plan is now available.

The Enterprise tier expands on the Team tier’s features with enhanced collaboration, enterprise-grade security, and improved scalability, making it ideal for larger organizations:

• Organization-wide cloud intelligence & security: Enables tailored data management across business units and teams for sharing insights.
• SAML Authentication: Provides secure and seamless SSO user experience using your identity provider.
• Multi-Organization RBAC: Allows granular access permissions across organizations and workspaces to protect sensitive data.
• Trusted Login Domains: Significantly reduces unauthorized access by restricting logins to trusted domains.
• Consolidated Usage and Billing: Simplifies resource and financial tracking with tenant-level visibility plus per organization/workspace details.

Get started in a 14-day free trial then switch to flexible, usage based pricing.

For more information, see the launch post.

Turbot Pipes now officially supports billing for your organization Enterprise plan via the AWS Marketplace.

For more information, see the Pipes billing docs.

Turbot Pipes now officially supports billing for your organization team plan via AWS Marketplace.

For more information, see the Pipes billing docs.

v0.12.0 of the Terraform Provider for Pipes is now available.

What's new?

• Resource pipes_workspace_datatank.
• Resource pipes_workspace_datatank_table.

Enhancements

• Resource pipes_workspace now supports instance_type.

The Google Workspace plugin is now available in all Pipes workspaces.

To get started, create a connection and add it to your workspace.

The Google Sheets plugin is now available in all Pipes workspaces.

To get started, create a connection and add it to your workspace.

The Google Directory plugin is now available in all Pipes workspaces.

To get started, create a connection and add it to your workspace.

The crt.sh plugin is now available in all Pipes workspaces.

To get started, create a connection and add it to your workspace.

The query API timeout has been increased from 1 minute to 2 minutes, allowing for greater flexibility in how you query your data.

All Pipes workspaces have now been upgraded to Steampipe v0.21.1.

For more information on this Steampipe release, see the release notes.

The Turbot Pipes app for Zapier, announced today, opens the world of DevOps data to Zap developers.

For more information, see the launch post.

Turbot Pipes plans & pricing are now available.

Free for Developers! Free trial & usage-based for Teams. Start immediately & cancel anytime.

For more information, see the launch post.

Datatank is now available in Turbot Pipes workspaces. Blow past API speed limits with scheduled data sync.

For more information, see the launch post.

All new Pipes workspaces will be running Steampipe v0.21.1 and existing workspaces will be upgraded by Monday 9th October 2023.

For more information on this Steampipe release, see the launch post or release notes.

The Pipes dashboard now shows a feed of the most recent changelog entries, allowing you to see what's new at a glance.

All Pipes workspaces have now been upgraded to Steampipe v0.20.12.

For more information on this Steampipe release, see the release notes.

All new Pipes workspaces will be running Steampipe v0.20.12 and existing workspaces will be upgraded by Monday 25th September 2023.

For more information on this Steampipe release, see the release notes.

The ServiceNow plugin is now available in all Pipes workspaces.

To get started, create a connection and add it to your workspace.

All Pipes workspaces have now been upgraded to Steampipe v0.20.11.

For more information on this Steampipe release, see the release notes.

All new Pipes workspaces will be running Steampipe v0.20.11 and existing workspaces will be upgraded by Monday 18th September 2023.

For more information on this Steampipe release, see the release notes.

The Shopify plugin is now available in all Pipes workspaces.

To get started, create a connection and add it to your workspace.

The Sentry plugin is now available in all Pipes workspaces.

To get started, create a connection and add it to your workspace.

The LaunchDarkly plugin is now available in all Pipes workspaces.

To get started, create a connection and add it to your workspace.

The WorkOS plugin is now available in all Pipes workspaces.

To get started, create a connection and add it to your workspace.

The UptimeRobot plugin is now available in all Pipes workspaces.

To get started, create a connection and add it to your workspace.

The New Relic plugin is now available in all Pipes workspaces.

To get started, create a connection and add it to your workspace.

The Turbot Guardrails plugin is now available in all Pipes workspaces.

To get started, create a connection and add it to your workspace.

The CohereAI plugin is now available in all Pipes workspaces.

To get started, create a connection and add it to your workspace.

The Turbot Pipes plugin is now available in all Pipes workspaces.

To get started, create a connection and add it to your workspace.

The GoDaddy plugin is now available in all Pipes workspaces.

To get started, create a connection and add it to your workspace.

The Docker Hub plugin is now available in all Pipes workspaces.

To get started, create a connection and add it to your workspace.

All Pipes workspaces have now been upgraded to Steampipe v0.20.10.

For more information on this Steampipe release, see the release notes.

All new Pipes workspaces will be running Steampipe v0.20.10 and existing workspaces will be upgraded by Monday 21st August 2023.

For more information on this Steampipe release, see the release notes.