BigQuery table design has a direct effect on how much data a query scans and how predictable that scan will be. Partitioning and clustering are […]
PDE
Google Cloud PDE: Choosing Dataflow, Dataproc, or BigQuery
Dataflow, Dataproc, and BigQuery all process large datasets on Google Cloud, but they solve different processing problems. Dataflow is a managed execution service for Apache […]
Google Cloud PDE: Pub/Sub Delivery Semantics
Reliable event ingestion depends on understanding what a messaging service guarantees and what the application must still guarantee for itself. Google Cloud Pub/Sub can provide […]
Google Cloud PDE: Dataplex Universal Catalog
Google Cloud’s data-catalog story has changed names. Dataplex Universal Catalog has transitioned to Knowledge Catalog, an AI-oriented catalog and context layer within Google’s broader data […]
Google Cloud PDE: Choosing Bigtable, Spanner, or BigQuery
Bigtable, Spanner, and BigQuery can all store very large amounts of data on Google Cloud, but that similarity is superficial. Bigtable is a wide-column, key-oriented […]