dbt — Data Build Tool Consulting

At HubSpot, a global customer experience platform, the data team faced challenges in managing their complex data architecture. James Densmore, the Director of Data Infrastructure, led the adoption of Snowflake, a cloud warehouse, to streamline data processes. This move eliminated the need for a dedicated database admin, thanks to Snowflake’s dynamic scaling and cloning features. 

However, data transformation issues persisted, especially with Apache Airflow. HubSpot’s analysts struggled with a messy code base and complex model dependencies, which hindered productivity and scalability. To address these challenges, HubSpot turned to dbt (data build tool), which empowered analysts to own their tooling and simplified data modeling. 

With dbt, analysts at HubSpot could easily define model dependencies and update models, leading to more modular and maintainable SQL queries. This shift not only enhanced the efficiency of the data team but also aligned with HubSpot’s culture of autonomy, empowering analysts to build productive and scalable analytics solutions. 

JetBlue Airways, renowned for its exceptional customer service, faced a major challenge in managing its expanding data infrastructure. The centralized data team at JetBlue, responsible for data transformation and compliance, encountered bottlenecks as data volumes surged. Ben Singleton, Director of Data Science & Analytics, recognized the need for a more collaborative approach to data management, allowing experts in various business functions to take greater ownership of their data. 

To revolutionize their data workflows, JetBlue adopted Snowflake and dbt, aligning with the modern cloud warehousing and analytics engineering workflow. This transition enabled JetBlue to achieve several key objectives: ensuring compliance and security, delivering real-time data for operational decisions, catching data quality issues proactively, and making data transformation accessible to a broader range of analysts. 

The implementation of Snowflake and dbt not only improved data transparency and documentation but also significantly enhanced the productivity and autonomy of JetBlue’s data teams. This shift to a more democratized approach to data access allowed JetBlue to effectively manage the challenges of a pandemic-stricken industry while preparing for a more data-driven future. The journey towards data democratization at JetBlue represents a radical transformation, setting a new strategic foundation for data management and analytics across the organization. 

At McDonald’s Nordics, operating in four markets with over 400 restaurants, the challenge was to unify their disparate data systems into one cohesive platform. This transformation was crucial for reporting to both the master franchise Food Folk and McDonald’s Global. Each market had its own IT and data warehouse solution, creating a complex and fragmented data landscape. 

To centralize their data architecture, McDonald’s Nordics selected dbt Cloud and Data Vault 2.0. dbt Cloud provided vital data lineage and scheduling capabilities, while Data Vault 2.0 offered a structured approach to organize and manage data effectively. 

The integration of AutomateDV significantly sped up the setup process, focusing on refining business logic. This new system enabled rapid access to historical data changes, streamlined troubleshooting, and built trust in data quality among business users. 

The transformation has led to more efficient data management and greater democratization within the organization. The next step is to train more team members in data modeling, enhancing the overall data capability of McDonald’s Nordics. This shift not only improves internal processes but also sets a new standard in the food service industry for managing complex data environments. 

Nasdaq, overseeing 30 stock exchanges, ventured into cloud technology in 2012, leading to a data warehouse launch and new marketplaces. This shift, while enhancing data infrastructure, also opened doors for advanced analytics and ETL processes. One significant step was empowering business users who previously struggled with complicated data requests. Nasdaq aimed to involve them directly in data transformation, adapting to clients’ needs for dynamic data access. 

The transition to a modern data stack involved overcoming challenges like legacy ETL tools and siloed teams creating their own data solutions. A major change was implementing dbt Cloud, which streamlined analytics and SQL models, enabling business users to engage directly with data. 

This move to dbt Cloud revolutionized data access for Nasdaq, particularly in their options business, leading to better data visibility and faster insights. Now, Nasdaq continues to expand this modern data approach, integrating new tools and planning to extend these benefits to international markets. 

Nitrogen, a leader in wealth management analytics, faced a critical challenge in expanding to larger firms. Tasked with creating a new data integration for a mid-sized client within six weeks, they encountered the limits of their legacy data infrastructure. Seeking a more scalable solution, Nitrogen turned to dbt Cloud and Snowflake, drawn by their simplicity and quick learning curve. 

This strategic shift resulted in successfully meeting the tight deadline, achieving the integration in half the usual time with fewer resources. The adoption of dbt Cloud and Snowflake not only accelerated data delivery but also significantly reduced operational costs. This efficiency improvement enhanced customer experience by providing wealth managers with earlier access to crucial market data. 

Looking forward, Nitrogen plans to extend dbt adoption across various teams, including compliance, and focus on enhancing data governance. This transition marks a significant advancement in Nitrogen’s data capabilities, supporting their growth and innovation in the wealth management industry.