Setting Up Reverse ETL with Fivetran

Fivetran has recently released a BigQuery source.
Here are my notes on its usage.

BigQuery database connector by Fivetran | Fivetran documentation

Assumptions

• Source is BigQuery
• Target is AWS Aurora(MySQL)

BigQuery

The key aspect we must consider is the permissions of the service account in Google Cloud Platform (GCP). This differs slightly from the source settings. For our particular situation, we require the roles of “BigQuery Job User” and “BigQuery Data Viewer”.

BigQuery database connector by Fivetran | Setup Guide

AWS Aurora

Essentially, we can adhere to the instructions provided below.

MySQL Aurora destination connector by Fivetran | Setup Guide

The primary concern is the user permissions for the database. This varies slightly from the source settings.

CREATE USER fivetran@'%' IDENTIFIED BY 'password';
GRANT SELECT, INSERT, UPDATE, DELETE, CREATE, DROP, ALTER, CREATE TEMPORARY TABLES, CREATE VIEW ON *.* TO fivetran@'%';

Restrictions

• can’t specify the database name
• can’t specify table name