The data ecosystem has changed drastically over the last six years, and we've witnessed the rise and fall of several different technologies. However, there's one constant that's remained the same, the cloud data warehouse.
Thanks to modern data platforms like Snowflake and Google BigQuery, consolidating your data into a centralized platform and addressing your analytical workloads is easier than ever. The problem is your data warehouse is only accessible to your technical users who know how to write SQL, so the platform you purchased to eliminate data silos has inevitably become a data silo itself. This is precisely why Reverse ETL is so important.
In this post you'll learn:
- What Is Reverse ETL?
- What’s the Difference Between ETL & Reverse ETL?
- The Modern Data Stack & Reverse ETL
- Reverse ETL vs. Point-Point-Integrations
- Reverse ETL vs. CDPs
- Why You Need Reverse ETL
- Reverse ETL Use Cases
- Reverse ETL: Build vs. Buy
- Choosing a Reverse ETL Tool
The Definition of Reverse ETL
Reverse ETL is the process of copying data from your central data warehouse to your operational systems of record, including but not limited to SaaS tools used for growth, marketing, sales, and support.
The definition above is packed, so let's briefly take a step back. Why would you want to move data out of your warehouse after spending so many resources to get it in there in the first place? The answer is relatively straightforward – all of your core business definitions live in the warehouse.
Think about your core metrics like items in cart, subscription type, workspaces created, playlists, pages viewed, purchase date, lifetime value, and annual recurring revenue. This list could go on and on, but the key takeaway is that all of your essential data models live in the warehouse. Reverse ETL is all about syncing the data in your warehouse to your downstream systems.
Data Being Synced to Salesforce
Sure, you could easily create reports and visualizations using this data in your BI tool, but these insights are much more powerful if they drive everyday operations for your business teams across sales, marketing, finance, and support – in tools like Hubspot, Salesforce, Netsuite, SAP, Workday, Gainsight, or Zendesk. Reverse ETL, therefore, has emerged as a crucial part of the modern data stack to close the loop between analysis and activation.
What’s the Difference Between ETL & Reverse ETL?
The traditional ETL process has been around since the 1970s, and data pipelines have remained essentially unchanged. For those unfamiliar, ETL stands for extract, transform, and load. It's the process of automatically extracting, transforming, and loading data into your desired destination (e.g. a data warehouse or data lake).
The ETL Process
Fully managed SaaS platforms have made this process even easier by offering pre-built connectors to extract and load your data. Dedicated transformation tools like dbt have given rise to a new technique known as ELT, where data is transformed after it is loaded into the warehouse. The question is: Why can't you use conventional ETL or ELT to move data out of your warehouse?
Most people don't know this, but Reverse ETL requires you to write reverse SQL, so moving data out of the warehouse and back into your operational systems and SaaS tools can be very complex.
The Reverse ETL Process
An ELT tool like Fivetran or Stitch is primarily used to power dashboards, whereas Reverse ETL is mainly used to power workflows, marketing campaigns, and general business processes where time sensitivity is critical.
Since ELT is mainly focused on merging data based on "updated_at" fields, time is the only parameter to take into account. However, since Reverse ETL queries directly against your warehouse, there are no "updated_at" fields, and that means you have to diff the changes between sync runs to ensure you are only syncing fresh data.
If you make a mistake with conventional ELT, you can simply delete your table and re-ingest your data. This is not the case with Reverse ETL because a platform like Hubspot does not have a time machine feature that lets you roll back to a previous state.
Ultimately, there are a ton of technical differences between ELT and Reverse ETL, and if you're interested in getting into the weeds, you can read our post here.
The Modern Data Stack & Reverse ETL
For the most part, every modern data stack has several core components that are the same across analytics teams, and usually, it looks something like this.
The Modern Data Stack 2.0
- Data Acquisition: the initial collection point of data (e.g. source systems, internal databases, operational systems, business tools, SaaS applications).
- Event Tracking: behavioral data that takes place on your website or app (e.g. signed in, workspace created, subscription type, product viewed).
- Data Integration: extracting and ingesting your data into a central analytics repository
- Storage/Analytics: the analytics layer where all of your disparate sources are consolidated to establish a single source of truth.
- Data Transformation: transforming, standardizing, and formatting your data into a model that fits your business.
- Business Intelligence (BI): the visualization layer where you can consume the unique data models your team has built to power better business decisions.
- Data Orchestration: the process of managing the dependencies between all of your various data flows (e.g. scheduling, automation, monitoring).
- Data Governance: the process of monitoring and managing all of your unique data assets.
While the technologies for each of these layers might differ from company to company, the overall components largely remain the same across industries. However, the modern data stack has left a gaping hole other technologies have tried to fill over the years but have failed in doing so. Reverse ETL has arisen as the tool of choice for the "last-mile problem" of helping you activate your data for operational analytics.
Reverse ETL is not a new concept by any means. Companies have been trying to activate their data for years. In the past, moving data out of the warehouse required you to either manually download/upload CSV files or build custom integrations and pipelines for every single one of your SaaS applications and end systems. Neither option was scalable.
Reverse ETL vs. Point-Point-Integrations
Point-to-point tools and integration technologies like Zapier, Tray, and Workato can be an attractive option for tackling Reverse ETL use cases because they let you send data from one platform to another without code. However, these platforms don't scale or integrate well with your current data stack. If you have just four applications, you'll quickly find yourself with 16 different pipelines (e.g. 4x4 = 16).
All of the platforms in this space work in a similar manner; they perform actions based on a trigger that you define (e.g. sending a marketing email in Hubspot when a lead is created in Salesforce). Inevitably this means you have to build custom workflows for every integration in your stack, and this can become an absolute nightmare as you weave in various dependencies, triggers, if/then clauses, and fail-safes (just look at this example of a workflow in Tray.)
Reverse ETL creates a hub and spoke approach, where the warehouse is your central source of truth, completely eliminating the complex web of pipelines and workflows that come with conventional point-to-point solutions.
Point-to-Point vs. Hub & Spoke
Reverse ETL vs. CDPs
In the world of customer data, you're probably familiar with customer data platforms (CDPs). Platforms like Segment made a name for themselves in the marketing world by creating a single platform where you can house all of your customer data and activate it across your various operational teams and marketing tools.
The main advantage of these types of platforms is that they offer built-in event collection for your behavioral data, identity resolution, and audience management tools. CDPs have several flaws though. Firstly, you don't actually own the data. CDPs force you to store data outside of your own cloud infrastructure.
In many cases, all of this data already lives in your warehouse, so you inevitably end up paying for storage twice. In addition to this, CDPs are extremely rigid because they don't support custom data models. They force you to use proprietary data models that only represent users and accounts. This is not helpful if you have unique objects like workspaces, subscriptions, and playlists.
At their core, CDPs are rigid black boxes that are not easily configurable in the context of a modern data stack. To truly own your data from end to end, you need to leverage Reverse ETL.
Why You Need Reverse ETL
While on the surface, it can seem like Reverse ETL is simply just focused on syncing data, there are three primary use cases for Reverse ETL: Data Activation, data automation, and data infrastructure.
Reverse ETL Powers Data Activation
Data Activation is the method of unlocking the knowledge sorted within your data warehouse and making it actionable by your business users in the end tools that they use every day. In doing so, Data Activation helps bring data people toward the center of the business, directly tying their work to business outcomes.
It's no longer enough to simply understand past behavior. You need to be able to predict and identify common patterns and attributes in your customers to take action immediately.
Since Reverse ETL is focused on syncing real-time data into your operational tools, you can rest assured that your teams have a holistic view of your customer data and the correct data to make the right decision.
Every company wants to be more data-driven. Yet the most daunting question for every lead is "how"? Deriving insights from data is part one, but the last mile of "analytics enablement" (e.g. translating those insights into action) is a different ball game.
Analytics enablement is typically seen as a people problem, and this is true to some extent – but how data is presented can play an equally significant role.
Imagine you're a B2B company trying to figure out which accounts your sales reps should focus on. In most scenarios, your data analyst would use SQL to derive characteristics of high-value leads and present them to you in a BI report. The problem is that this data isn't actionable and to your analyst's dismay, the report is rarely even opened.
A traditional analytics enablement outlook to this problem would be to train sales reps on how to leverage BI reports as part of their day-to-day workflow. In practice, this is tough because data enablement is the reason most data projects fail.
Instead of training your sales reps to use BI reports, what if you could just empower your analysts to just feed lead scores from your data warehouse into a custom field in Salesforce? This same thought process can be applied to basically any operational analytics use case.
Reverse ETL Enables Data Automation
Data Activation is flashy, but in reality, companies are filled with far less glamorous problems when it comes to data. In any sizable organization, there are tons of manual requests for data floating around, and with any manual process, there's always the question of how to automate it.
Here are a few common examples of everyday data requests from various teams:
- Sales wants the list of webinar attendees to import as leads into Salesforce.
- Marketing wants to sync a list of new users to Google Ads for retargeting.
- Support wants search Zendesk for accounts with premium support.
- Product wants a Slack feed of customers who have enabled a feature.
- Accounting wants customer attributes to be synced to NetSuite.
- Finance wants a CSV of rolled-up transaction data to use in Excel or Google Sheets.
How Reverse ETL Powers Business Teams
There's a high probability that you've had to deal with at least one of these requests. The data is likely already available in your data warehouse. With Reverse ETL, SQL is really all you need to extract and sync that data to your external tools – thus making it the simplest solution.
Reverse ETL Is a Core Piece of Data Infrastructure
Reverse ETL has also emerged as a general-purpose solution in data infrastructure and software engineering, and there are two primary use cases powering this:
- Personalizing customer experiences
- Accessing disparate data sources
Personalizing Customer Experiences with Reverse ETL
The most obvious use case for Reverse ETL in software engineering is activating your analytics and data science models to build personalized customer experiences.
E-commerce is a great example. Pretend your data science team calculates a score on top of your data warehouse or data lake to define a user's likelihood of buying a product. And your growth team wants to drive more purchases by offering discounts to users who are deemed unlikely to make a purchase. Since your warehouse is too slow to serve user-facing experiences, your engineers could simply use a Reverse ETL tool to sync a propensity score in your warehouse to your production database -- thus giving you the ability to serve in-app customers with personalized experiences.
Accessing Disparate Data Sources
Today, customer data is spread across dozens – if not hundreds of disparate systems. Sometimes, your cloud applications need to access information from disparate data sources.
Pretend you're a B2B SaaS company with enterprise customers on a contract. Every time a new enterprise is onboarded, your sales deal desk records each customer's credit allotment in Salesforce. Your customers keep asking to see their credit allotment inside your web app, but your developers don't want to integrate with Salesforce. However, chances are that Salesforce data is already available in your data warehouse (via an ELT tool like Fivetran).
With Reverse ETL, you can sync relevant Salesforce information from your warehouse to the production database that powers your app, giving your customers direct access to their billing information.
The possibilities are endless, but the key takeaway is that Reverse ETL is becoming a core part of the software engineering toolkit, and it isn't limited to "data projects."
Reverse ETL Use Cases
Although it's relatively easy to see why you need Reverse ETL, it's not always as straightforward to see what that actually entails. There are basically a near-limitless number of use cases for Reverse ETL, but in many scenarios, the use cases tend to be centered around your data teams, marketing teams, and sales teams.
Advertising is arguably the backbone of any marketing team, and figuring out how to increase match rates, improve return on ad spend (ROAS), and decrease customer acquisition costs (CAC) is at the forefront of every decision. Enriching your advertising platforms with rich behavioral data about your customers for retargeting campaigns and lookalike audiences can be challenging, as the typical process involves manual downloading and uploading individual data sets.
Lucid, the visual collaboration suite and visual diagramming platform, faced this exact problem. Since adopting Reverse ETL, Lucid has seen a 56% increase in ROAS in Google and a 37% increase in new users.
Imperfect Foods, the leading online grocer at the forefront of eliminating food waste, saw similar benefits, reducing the CAC by 15% and increasing customer reactivations by 53%.
The dream of every sales rep is to have a centralized platform with a holistic view of the customer. Customer relationship management platforms (CRMs) arose as the first platform to tackle this challenge, but these platforms really only capture sales and marketing interactions.
In reality, your sales team needs and wants access to the unique behavioral data and product usage data that lives in your warehouse so they can track every step in the customer journey and accelerate deal cycles.
In reality, your sales team needs and wants access to the unique behavioral data and product usage data that lives in your warehouse so they can track every step in the customer journey and accelerate deal cycles.
Gorgias, the e-commerce helpdesk platform, uses Reverse ETL for this exact purpose and syncs important behavioral data about prospects and accounts directly to Hubspot so individual sales reps can prioritize high-value accounts, enroll contacts in customized email sequences in real-time, and monitor product usage spikes. Since implementing Reverse ETL, Gorgias has grown its outbound pipeline by 60-70% and seen a 2x in quarterly revenue.
The key to improving your product and driving adoption is experimentation and iteration. To do this, your product teams need access to the vital behavioral data that lives in your warehouse so they can answer questions like:
- Where are our qualified users dropping off?
- How can we increase conversions for qualified users?
- What is our most popular feature?
- Where do customers drop off in the onboarding process?
This is the same challenge that CircleCI ran into. As one of the largest platforms CI/CD platforms with over 30,000 organizations using the product, CircleCI generates tons of new users. Understanding user behavior, KPIs, and analyzing experiments is nearly impossible because all of CircleCI's core data models live in the data warehouse.
With Reverse ETL, CircleCI is able to sync existing data models and key events to Amplitude and empower the product team to iterate and experiment at a moment's notice and answer questions that can have a huge impact on the underlying business.
Lowering customer churn is always at the forefront of customer success teams, so you need to be able to proactively identify red flags and act on them before they happen. Doing this means giving your success teams a clearer picture of your product usage data and account level activity.
Blend, a publicly traded fintech company that handles more than $5 billion in transactions every day, uses Reverse ETL to solve this same problem. Leveraging Reverse ETL to sync customer data from the data warehouse to Asana and Salesforce, Blend is able to ensure visibility across teams, assess ROI, and better understand when and where accounts are under-serviced.
Your business teams are not the only ones to benefit from Reverse ETL. It can also have a massive impact on your data teams. No data engineer wants to build or maintain custom integrations; they'd much rather be building data models and optimizing your current technology stack.
Nando’s (the world-famous peri-peri chicken restaurant) experienced a similar problem, but since implementing Reverse ETL, engineering time has dropped from 80% to 20%.
Seesaw, the online learning platform lowered the time it took to integrate with Salesforce from days to minutes.
Reverse ETL Is Not Just Syncing Data
While at face value, it seems like most of the use cases for Reverse ETL are primarily focused on syncing data to downstream applications, this is not the case. Reverse ETL is also used to power notifications in messaging tools like Slack and workflows in various SaaS applications like Hubspot.
Vendr, one of the largest SaaS platforms for buying SaaS products, uses Reverse ETL for this exact use case. Vendr leverages Reverse ETL to escalate messages directly to customers in Slack and also notify employees every time a sales rep saves customers over 25% in savings. Every time a transformation job finishes running in the warehouse (via dbt), Vendr syncs data directly to Hubspot to trigger workflows for specific emails to both buyers and sellers.
Reverse ETL: Build vs. Buy
If you've ever bought enterprise software, then you'll know that there are always pros and cons to purchasing a purpose-built solution and building one in-house. If you're leaning toward the DIY camp, you'll likely need spare data engineering resources (if you have extra resources, you are one of the few).
Building one-off integrations in-house can get complicated very quickly because every third-party system is equipped unique API that is constantly updating and changing, and that means you'll either have to download/upload manual CSV files or be forced to build a unique integration for every tool in your data stack.
Third-party APIs & CSVs
You'll also be forced to monitor and manage each integration because a single change in an API can easily break your data flows, and this isn't even mentioning all of the factors you have to consider when integrating with third-party APIs, including:
- Mapping fields
- Querying source data
- Rate limits
- Error handling
Needless to say, there are a lot more complexities involved with Reverse ETL. Depending on the resources in your engineering team, it might make sense to go this route. Either way, you're going to need to learn how to integrate with third-party APIs.
Choosing a Reverse ETL Tool
A fully managed Reverse ETL platform gives you the ability to schedule your data syncs from your warehouse in the same way that you would schedule ELT jobs to ingest data into your warehouse. Implementing a dedicated Reverse ETL enables your engineers to focus on tasks that actually impact your business rather than doing the tedious job of building and maintaining Reverse ETL pipelines.
If you’re evaluating Reverse ETL platforms there are a lot of factors to consider:
- Ease of Use: These days, most tools are based on SQL, so your Reverse ETL tool should be no different. It should be accessible to non-technical users who want to self-serve.
- Integrations: There's no point in using a Reverse ETL tool that doesn't integrate with the unique applications in your business. Before choosing a tool, you need to ensure that it offers integrations that support your specific use cases.
- Sync Flexibility: Data syncs run the risk of running up against API limits, so it's imperative that your Reverse ETL provider is fast, efficient, and reliable, only syncing the data that's been changed or updated.
- Version Control: Your data syncs are just as valuable as your production code, and that means your Reverse ETL platform should integrate natively with Git so you can track incremental changes, roll back errors, and support bi-directional updates.
- Live Debugging: Your syncs will inevitably fail at some point or another, so a live debugger is extremely important when it comes to identifying what, where, and when something went wrong.
- Configurable Alerting: You need to have direct control over your alerts. Alerting should not be limited to any specific tool, and you should be able to choose how you receive alerts.
- Visual Audience Builder: A visual interface for audience building is a must for any Reverse ETL platform because it gives your marketers an easy way to define complex cohorts for activation using related data models and important behavioral event data.
- Compliance: Security is of the utmost importance, so if your Reverse ETL provider doesn't meet industry-specific standards like SOC 2 Type 2, HIPAA, GDPR, or Privacy Shield, you shouldn't even consider them.
- Multi-Region: Data residency laws are constantly changing, so your Reverse ETL tool should not be limited to a single cloud region.
- Community/Vendor Support: Things inevitably go wrong, and when they do, you need easy access to rich documentation, real-time customer support, and a Reverse ETL vendor that can guarantee 99.9% SLAs to reduce downtime.
- Transparent & Scalable Pricing: Before buying any tool, you should have complete visibility into your vendor's pricing model, whether it's based on consumption, the number of integrations, or fields per sync. Pricing should not be prohibitive based on the volume of your data, and it should scale as your organization grows.
Reverse ETL is a brand new category in the data space, and like any hot category, many companies will try and ride this wave. If you prefer investing in best-in-class tools and want to have a fully managed Reverse ETL solution up and running in a matter of minutes, give Hightouch a try for free.
If you want to learn more about Reverse ETL, download our Reverse ETL Buyer's Guide.