Start here
Getting started
Replicate MySQL tables into BigQuery with Quayen in about 15 minutes: connect MySQL, connect BigQuery, choose tables.
Quayen keeps an up-to-date copy of your MySQL tables in BigQuery. It copies each table once, then follows MySQL's binary log to apply every insert, update and delete within seconds of it happening.
What you need
- A MySQL 8 database (Amazon RDS, Aurora, Google Cloud SQL, Azure Database for MySQL, or self-hosted) where you can change server settings and create a user.
- A Google Cloud project with billing turned on. The free BigQuery sandbox doesn't allow streaming.
- About 15 minutes. No MySQL or BigQuery expertise needed: each step tells you exactly what to click.
1. Connect MySQL
In the app, open Sources → Connect database and pick your host. The guide shows how to turn on row-based binary logging, create a read-only user, and allow network access. The connection test explains any problem in plain English and links to the fix. Details: MySQL setup.
2. Connect BigQuery
Open Destinations → Connect BigQuery. Create a service account with two roles, upload its JSON key, and choose a dataset name and location. Details: BigQuery setup.
3. Create a pipeline
Open Pipelines → New pipeline, pick the source, the destination and the tables. Optionally partition large tables by a date column, and choose how often the up-to-date tables refresh (every 5 minutes by default). Start it: existing rows are copied first, then changes stream continuously.
Next: how it works and keeping BigQuery costs low.