wqwqHow to create a merge table in BigQueryIn this post, I introduce the merge function in BigQuery. The use cases where we utilize it are mainly to eliminate data duplication. It…2 min read·Mar 24, 2024----
wqwqExecute BigQuery Transfer Service by WorkflowThe BigQuery Transfer Service automates data transfers to BigQuery. Executing it via a workflow allows scheduling, dependency management…3 min read·Mar 16, 2024----
wqwqWho is Issued the ID Token in the GitHub Actions OIDC Workflow?Question3 min read·Feb 25, 2024----
wqwqAutomating Budget Alerts with Cloud FunctionsThis guide provides a comprehensive overview of how to leverage Cloud Functions to send budget alerts to Slack, a popular communication…3 min read·Feb 17, 2024----
wqwqNavigating High-Volume Messaging Challenges in AWS Lambda Using ReportBatchItemFailuresIntroduction2 min read·Feb 11, 2024----
wqwqA Deep Dive into Aurora Export and BigQueryI wrote down how to transfer the data from AWS to GCP before. In the below article, I introduced 「AWS Aurora Export + BigQuery Data…2 min read·Feb 10, 2024----
wqwqHow to transfer the data from AWS to GCPWe are mainly using AWS. But we decided to use BigQuery. There are many benefits to using BigQuery. In this scenario, we have to move the…2 min read·Feb 4, 2024----
wqwqHow to escape <> in TerraformSometimes, we need to use < and > in Terraform. However, in these cases, < automatically gets converted to u003c. I’d like to document…1 min read·Jan 27, 2024----
wqwqHow to propagate trace ID in Cloud Pub/SubTo initiate Opentelemetry in a microservice environment, it is often necessary to propagate information like trace IDs, among others. I…1 min read·Jan 23, 2024----
wqwqSetting Up Reverse ETL with FivetranFivetran has recently released a BigQuery source. Here are my notes on its usage.1 min read·Jan 17, 2024----