New: See the Lineage of your Transformations
Check out our update on Lineage, you can now see the lineage from dbt and Fivetran transformations!
Recently we’ve published an article about the examples, concepts of techniques of a Data Lineage. In the article, we discussed the importance of lineage, and how it helps teams to understand how data flows from the origin to its destination, and is a great enabler in ensuring data quality, compliance and governance.
So, I’ve got great news to share with you, we’ve updated the lineage to support your transformation tools! That’s right, you can now see dbt and Fivetran transformation within the Lineage feature.
More visibility on your transformations
You can also expand further depth into the lineage by clicking on the “+” icons.
Next example is one where I selected a dbt virtual table to view the lineage for purchase_order.
We also show the column-to-column relationships via the dotted lines.
Of course, you can also view the lineage from any table in your data warehouse or database. Check out the lineage from my PostgreSQL table cart.
How to get started
If you’re interested to see the lineage of your transformations within decube, all you need to do is to connect your tools with our available integrations! For example, if you’d like to see a transformation from your PosgreSQL table to dbt, you’ll need to have both PosgreSQL and dbt connected to see the full lineage.
If you’ve already connected your dbt or Fivetran, all of you have to do now is to head to the My Account page, and click on the Modify button on your data source. This will bring up the Additional Config page. From the transformation jobs you have, we figure out the connection names referenced, and list them out here so you can map them to existing connections within decube.
Tip: If this is your first time on decube, it is advisable for you to add your data warehouses and databases first before adding your transformation tools, so that you can do the mapping as soon as you add your dbt or Fivetran connections.
Interested in seeing what we’re working on next? Check out our Public Roadmap.