Changelog

Subscribe to all changelog posts via RSS or follow #changelog on our Slack community to stay updated on everything we ship.

v0.13.0 of the Pipes SDK Go is now available.

Breaking changes

  • Get_1 method in UserWorkspaceSchemasService used to list tables for a schema renamed to ListTables to denote its exact purpose.
  • Get_1 method in OrgWorkspaceSchemasService used to list tables for a schema renamed to ListTables to denote its exact purpose.

What's new?

  • Add support for GetTable method to UserWorkspaceSchemasService to get a specific table for a schema.
  • Add support for GetTable method to OrgWorkspaceSchemasService to get a specific table for a schema.

Enhancements

  • Install and Update for both flowpipe and powerpipe mods now support archived mod upload via multipart/form-data request.
  • Add SourceType to model WorkspaceMod to denote the source of the mod i.e. repository or archive.
  • Add AggregatedBy to model WorkspaceSchema to store the list of aggregators that are using the schema.

Turbot Pipes' latest update enhances its built-in query editor with improved schema navigation, integrated documentation, pre-built query examples, and powerful search, making it faster and easier for teams to explore and query cloud data.

For more information on this release, see the blog post or refer to the documentation.

All Pipes workspaces are now running Steampipe v1.1.0.

For more information on this Steampipe release, see the release notes.

The schema list view in the Steampipe query editor now hides aggregated connections by default. This change helps highlight the key schemas whilst also improving readability of the list, especially in workspaces with a large number of aggregated connections.

You can still view the aggregated connections by clicking the Show Aggregated Connections option via the schema list settings button. This will expand the list to show all connections, including the aggregated ones.

Persistent workspaces now support high-performance SSD storage. This allows you to run your workloads on faster storage, which can be especially useful for queries that require high IOPS or low latency.

Any new persistent workspaces created will automatically use SSD storage. We'll gradually migrate existing persistent workspaces to SSD storage over the next few weeks. This change is included in the current pricing model and will not incur any additional cost.

Powerpipe and Flowpipe services in Pipes now support installing mods from an archive file.

For more information, check out the respective docs for Powerpipe or Flowpipe.

Enhancements:

  • The maximum amount of rows that can be fetched via the query API has been increased from 5,000 to 25,000, allowing users to retrieve more data in a single request.
  • Any query executed via the API that ran for 2 minutes prior to this change would be timed out and no data would be returned. The query API will now return all data fetched up to that point if the 2 minute limit is reached.
  • Any timed out query API responses that contain data will now have a 206 (Partial Content) status, with 408 (Request Timeout) still being the status for any requests that have timed out with no data.

All Pipes workspaces are now running Powerpipe v1.2.0.

For more information on this Powerpipe release, see the release notes.

v0.15.0 of the Terraform Provider for Pipes is now available.

Breaking Changes

  • Attribute github_installation_id for resource pipes_tenant_integration is now of type int instead of string.
  • Attribute github_installation_id for resource pipes_organization_integration is now of type int instead of string.
  • Attribute github_installation_id for resource pipes_user_integration is now of type int instead of string.

What's new?

  • Data Source pipes_organization_integration.
  • Data Source pipes_tenant_integration.
  • Data Source pipes_user_integration.
  • Data Source pipes_workspace.
  • Data Source pipes_workspace_flowpipe_pipeline.
  • Resource pipes_tenant_notifier.
  • Resource pipes_organization_notifier.
  • Resource pipes_user_notifier.
  • Resource pipes_workspace_notifier.
  • Resource pipes_workspace_flowpipe_mod.
  • Resource pipes_workspace_flowpipe_mod_variable.
  • Resource pipes_workspace_flowpipe_trigger.

Enhancements

  • Add last_activity_at attribute to the pipes_tenant_member resource to track the last time a user performed an activity in the tenant.
  • Add last_activity_at attribute to the pipes_organization_member resource to track the last time a user performed an activity in the organization.
  • Add last_activity_at attribute to the pipes_organization_workspace_member resource to track the last time a user performed an activity in the workspace.

Integrate your developer account, team or custom tenant with GitLab, enabling you to install custom Powerpipe or Flowpipe mods from public or private projects. Push changes for instant deploys and live updates.

For more information, check out the docs.

All Pipes workspaces are now running Powerpipe v1.1.0.

For more information on this Powerpipe release, see the release notes.

Custom tenant, organization and workspace people pages now show the last activity date for each member, allowing owners to track usage of their environments.

For more information, check out the tenant, organization and workspace people docs.

Custom tenant settings now allow owners to control workspace snapshot visibility settings, restricting the use of publicly-shared snapshot links.

For more information, check out the docs.

The Okta plugin in Pipes now supports max_backoff, max_retries and request_timeout settings.

To get started, create an Okta connection and add it to your workspace.

All Pipes workspaces are now running Steampipe v1.0.0.

For more information on this Steampipe release, see the launch post or check out the release notes.

All Pipes workspaces are now running Powerpipe v1.0.0.

For more information on this Powerpipe release, see the launch post or check out the release notes.

With a web UI, point-and-click mod installation, and easy integration with Slack and GitHub, Pipes takes workflows-as-code to the next level.

For more information, see the launch post or check out the docs.

All the components of Turbot's open source suite are now fully integrated into Pipes.

For more information, see the launch post or check out the docs.

All Pipes workspaces are now running Steampipe v0.24.0.

For more information on this Steampipe release, see the release notes.

GCP integrations now make use of temporary credentials via service account impersonation using the Service Account Token Creator role.

For more information, check out the docs.

v0.14.0 of the Terraform Provider for Pipes is now available.

Breaking Changes

  • Functionality for resource resources/pipes_workspace_connection moved to manage connections at the workspace level. Previously, the resource used to manage attachment of connections to the workspace defined at the respective identity level. Please follow the migration guide for migrating your existing configuration into the new model.
  • Resource resources/pipes_connection does not support management of user level connections in line with changes in Pipes.

What's new?

  • Resource pipes_organization_connection
  • Resource pipes_organization_connection_folder
  • Resource pipes_organization_connection_folder_permission
  • Resource pipes_organization_connection_permission
  • Resource pipes_organization_integration
  • Resource pipes_tenant_connection
  • Resource pipes_tenant_connection_folder
  • Resource pipes_tenant_connection_folder_permission
  • Resource pipes_tenant_connection_permission
  • Resource pipes_tenant_integration
  • Resource pipes_user_integration
  • Resource pipes_workspace_connection_folder
  • Resource pipes_workspace_schema

Enhancements

  • Resource resources/pipes_workspace_mod add support for storing attribute state_reason

v0.10.0 of the Pipes SDK Go is now available.

What's new?

  • Intregation Management APIs for Tenants, Users, Organizations, UserWorkspaces and OrgWorkspaces.
  • Tenant Connection Management APIs.
  • Tenant Connection Folder Management APIs.
  • User Connection Folder Management APIs.
  • Organization Connection Management APIs.
  • Organization Connection Folder Management APIs.
  • Workspace Connection Management APIs.
  • Workspace Connection Folder Management APIs.
  • Permission Management APIs for Connections and ConnectionFolders.

Enhancements

  • Add support for installing mods that are associated to integrations.
  • Add support for setting search path prefix for a workspace.

Import a tree of folders and projects as Pipes connections, control permissions for workspaces, and auto-create aggregators.

For more information, see the launch post or check out the docs.

You can now create connections at the custom tenant, organization or workspace level in Pipes, along with grouping of these within folders to allow easier sharing of related connections.

This is coupled with a fine-grained permissions model, allowing you to share connections & folders broadly across a custom tenant, or restrict access to specific organizations and/or their workspaces.

For more information, check out the docs:

Import a tree of management groups and subscriptions as Pipes connections, control permissions for workspaces, and auto-create aggregators.

For more information, see the launch post or check out the docs.

Import a tree of OUs and accounts as Pipes connections, control permissions for workspaces, and auto-create aggregators.

For more information, see the launch post or check out the docs.

All Pipes workspaces are now running Steampipe v0.23.2.

For more information on this Steampipe release, see the release notes.

All Pipes workspaces are now running Powerpipe v0.4.0.

For more information on this Powerpipe release, see the release notes.

Integrate your developer account, team or custom tenant with GitHub, enabling you to install custom Powerpipe mods from public or private repositories. Push changes for instant deploys and live updates.

For more information, see the launch post or check out the docs.

All new Pipes workspaces will be running Powerpipe v0.2.0 and existing workspaces will be upgraded by Monday 29th April 2024.

For more information on this Powerpipe release, see the release notes.

v0.13.2 of the Terraform Provider for Pipes is now available.

Bug fixes

  • pipes_workspace_datatank_table: Set PartPer setting for datatank table to be nil if nothing is passed in configuration while updating a datatank table. (#23)

Enhancements:

  • resources/pipes_workspace: Add support for passing desired_state, db_volume_size_bytes attribute when creating or updating a workspace. Add missing attribute state_reason.
  • resources/pipes_workspace_pipeline: Add support for passing desired_state attribute when creating or updating a pipeline. Add attributes state and state_reason.
  • resources/pipes_workspace_datatank: Add support for passing desired_state attribute when creating a datatank.
  • resources/pipes_workspace_datatank_table: Add support for passing desired_state attribute when creating a datatank_table.

All new Pipes workspaces will be running Powerpipe v0.4.1 and existing workspaces will be upgraded by Monday 29th July 2024.

For more information on this Powerpipe release, see the release notes.

All new Pipes workspaces will be running Steampipe v0.22.1 and existing workspaces will be upgraded by Monday 18th March 2024.

For more information on this Steampipe release, see the release notes.

All new Pipes workspaces will be running Powerpipe v0.1.2 and existing workspaces will be upgraded by Monday 18th March 2024.

For more information on this Powerpipe release, see the release notes.

v0.13.1 of the Terraform Provider for Pipes is now available.

Bug fixes

  • Ensure tags are passed during creation of resource pipes_workspace_pipeline and are only updated when a valid value is present in the Terraform configuration.

All new Pipes workspaces will be running Steampipe v0.22.0 and existing workspaces will be upgraded by Monday 11th March 2024.

For more information on this Steampipe release, see the release post or release notes.

Dashboards in Turbot Pipes are now powered by Powerpipe, allowing you to filter, group and share custom views of your cloud benchmarks.

All new Pipes workspaces will be running Powerpipe v0.1.0 and existing workspaces will be upgraded by Monday 11th March 2024.

For more information on the launch of Powerpipe, see the launch post or release notes.

The timeout for scheduled snapshot pipelines has been extended from 10 minutes to 1 hour, giving complex benchmarks and dashboards longer to successfully complete.

v0.13.0 of the Terraform Provider for Pipes is now available.

What's new?

  • Data Source pipes_tenant.
  • Resource pipes_tenant_member.

Enhancements

  • Resource pipes_organization_member now supports adding users directly to an organization in a custom tenant, rather than by invitation.

v0.12.1 of the Terraform Provider for Pipes is now available.

Bug fixes

  • Omitting the PartPer setting for a pipes_workspace_datatank_table resource would have previously resulted in an error, meaning you had to pass connection as the value. This field is now optional, allowing single part tables to be defined.

Turbot Pipes Enterprise plan is now available.

The Enterprise tier expands on the Team tier’s features with enhanced collaboration, enterprise-grade security, and improved scalability, making it ideal for larger organizations:

  • Organization-wide cloud intelligence & security: Enables tailored data management across business units and teams for sharing insights.
  • SAML Authentication: Provides secure and seamless SSO user experience using your identity provider.
  • Multi-Organization RBAC: Allows granular access permissions across organizations and workspaces to protect sensitive data.
  • Trusted Login Domains: Significantly reduces unauthorized access by restricting logins to trusted domains.
  • Consolidated Usage and Billing: Simplifies resource and financial tracking with tenant-level visibility plus per organization/workspace details.

Get started in a 14-day free trial then switch to flexible, usage based pricing.

For more information, see the launch post.

Turbot Pipes now officially supports billing for your organization Enterprise plan via the AWS Marketplace.

For more information, see the Pipes billing docs.

Turbot Pipes now officially supports billing for your organization team plan via AWS Marketplace.

For more information, see the Pipes billing docs.

v0.12.0 of the Terraform Provider for Pipes is now available.

What's new?

  • Resource pipes_workspace_datatank.
  • Resource pipes_workspace_datatank_table.

Enhancements

  • Resource pipes_workspace now supports instance_type.

The query API timeout has been increased from 1 minute to 2 minutes, allowing for greater flexibility in how you query your data.

All Pipes workspaces have now been upgraded to Steampipe v0.21.1.

For more information on this Steampipe release, see the release notes.

Turbot Pipes plans & pricing are now available.

Free for Developers! Free trial & usage-based for Teams. Start immediately & cancel anytime.

For more information, see the launch post.

Datatank is now available in Turbot Pipes workspaces. Blow past API speed limits with scheduled data sync.

For more information, see the launch post.

All new Pipes workspaces will be running Steampipe v0.21.1 and existing workspaces will be upgraded by Monday 9th October 2023.

For more information on this Steampipe release, see the launch post or release notes.

The Pipes dashboard now shows a feed of the most recent changelog entries, allowing you to see what's new at a glance.

All Pipes workspaces have now been upgraded to Steampipe v0.20.12.

For more information on this Steampipe release, see the release notes.

All new Pipes workspaces will be running Steampipe v0.20.12 and existing workspaces will be upgraded by Monday 25th September 2023.

For more information on this Steampipe release, see the release notes.

All Pipes workspaces have now been upgraded to Steampipe v0.20.11.

For more information on this Steampipe release, see the release notes.

All new Pipes workspaces will be running Steampipe v0.20.11 and existing workspaces will be upgraded by Monday 18th September 2023.

For more information on this Steampipe release, see the release notes.

All Pipes workspaces have now been upgraded to Steampipe v0.20.10.

For more information on this Steampipe release, see the release notes.

All new Pipes workspaces will be running Steampipe v0.20.10 and existing workspaces will be upgraded by Monday 21st August 2023.

For more information on this Steampipe release, see the release notes.