New: See the Lineage of your Transformations

Check out our update on Lineage, you can now see the lineage from dbt and Fivetran transformations!

By

Melanie Yong

Updated on

January 10, 2024

Recently we’ve published an article about the examples, concepts of techniques of a Data Lineage. In the article, we discussed the importance of lineage, and how it helps teams to understand how data flows from the origin to its destination, and is a great enabler in ensuring data quality, compliance and governance. 

So, I’ve got great news to share with you, we’ve updated the lineage to support your transformation tools! That’s right, you can now see dbt and Fivetran transformation within the Lineage feature.

More visibility on your transformations

After you connect your dbt or Fivetran, you can now head into the Asset Details of any dbt or Fivetran virtual table and click on the Lineage tab. 

Example of a Data Lineage when you navigate to a Fivetran virtual table.

You can also expand further depth into the lineage by clicking on the “+” icons.

Clicking on the "+" icon expands the depth of the lineage.

Next example is one where I selected a dbt virtual table to view the lineage for purchase_order.

Example via dbt transformation.

We also show the column-to-column relationships via the dotted lines.

Of course, you can also view the lineage from any table in your data warehouse or database. Check out the lineage from my PostgreSQL table cart.

Example when viewing from a table from PostgreSQL.

How to get started

If you’re interested to see the lineage of your transformations within decube, all you need to do is to connect your tools with our available integrations! For example, if you’d like to see a transformation from your PosgreSQL table to dbt, you’ll need to have both PosgreSQL and dbt connected to see the full lineage.

If you’ve already connected your dbt or Fivetran, all of you have to do now is to head to the My Account page, and click on the Modify button on your data source. This will bring up the Additional Config page. From the transformation jobs you have, we figure out the connection names referenced, and list them out here so you can map them to existing connections within decube. 

Map your data source connections to the connection names we detect from your transformation job.

Tip: If this is your first time on decube, it is advisable for you to add your data warehouses and databases first before adding your transformation tools, so that you can do the mapping as soon as you add your dbt or Fivetran connections.

Interested in seeing what we’re working on next? Check out our Public Roadmap.

Table of Contents

Read other blog articles

Grow with our latest insights

Sneak peek from the data world.

Thank you! Your submission has been received!
Talk to a designer

All in one place

Comprehensive and centralized solution for data governance, and observability.

decube all in one image