dbt integration with Holistics
Holistics fully integrates with your dbt project, allows you to perform data modeling and transformation at dbt layer, and push those definitions to Holistics BI layer.
(Coming in Q1 2022)
How does Holistics work with dbt?
Are you already using dbt for your modeling and data transformation? And you’re wondering how well Holistics would work with dbt, given that Holistics seems to have a modeling layer as well?
Our modeling layer is not meant to replace dbt’s modeling layer, it is meant to complement dbt’s modeling layer. dbt is a transformation tool, and Holistics is a BI tool.
You use dbt for the transformation of data into pre-built tables. You pull those tables (i.e materialized views) into Holistics. In Holistics, you define logical metrics and formulas, and turn those into datasets and reports for end consumers.
You leverage dbt as a central place for data documentation, which can be synced with Holistics, and use Holistics as the the central entrypoint for data consumers.
Read below for further integrations between Holistics and dbt that we’re rolling out in the next couple of months.
1. Transform data in dbt
Use dbt to transform and materialize into data tables inside data warehouse.
2. dbt models mirrored in Holistics
dbt models and data are loaded into Holistics for further manipulation.
3. Define metrics in Holistics
Define custom measures and formulas in Holistics for exploration.
4. Build reports and datasets for end consumers
End users perform self-service exploration based on predefined datasets and reports.
Native dbt + Holistics integration
When you change metadata in dbt model, Holistics automatically picks those up and reflect into the BI layer. Relevant datasets and reports will be updated.
Exposing dbt metadata to business users
Business users can get access to schema metadata that data teams define in dbt docs.
Continuous flow trigger
When dbt runs and underlying table data is updated, trigger will inform Holistics. Holistics can refresh data in relevant reports using that model.
Single code repository
You can maintain a single Github repository with both dbt and Holistics (AML) code. This represents the customer's analytics pipeline as code.
Frequently Asked Questions
What are the things should be done in dbt, and what should be done in Holistics?
You can use dbt to clean, reshape and preaggregate your data, then use Holistics modeling to build custom measures and define relationships to allow Holsitics to write SQL queries gainst your data schema.