How to schedule and run BigQuery using Cloud Composer?
Cloud Composer Cloud Composer is a fully managed orchestration tool in GCP. It is used to author, schedule and monitor
Continue readingHow to copy Hadoop data from On-Premise to Google Cloud Storage(GCS)?
Cloud Storage Connector Cloud Storage Connector is an open source Java library developed by Google. It allows us to copy
Continue readingHow to load JSON data from Cloud storage to BigQuery?
Load JSON data from Cloud storage to BigQuery The JSON file can be loaded from Cloud Storage to a new
Continue readingCreate Dataproc Cluster, submit Hive job and delete cluster using gcloud command
Cloud Dataproc in Google Cloud Platform Cloud Dataproc is Google’s managed service for running Hadoop and Spark jobs. It allows
Continue readingCreate table as Select, Create table Copy and Create table Like in BigQuery
Create Table As Select (CTAS) in BigQuery The CTAS statement creates a new table by copying the schema and data
Continue readingConcat and concat_ws function in Hive with examples
Concat function in Hive The concat() function add two or more strings or bytes together. If any of the value
Continue readingHow to add a column to existing table in BigQuery?
ALTER TABLE ADD COLUMN statement Alter statement allows us to modify the structure of the existing table. Using Alter Table
Continue readingCoalesce function in Hive with examples
COALESCE function in Hive Coalesce is a conditional function in Hive which is used to handle the NULL values. It
Continue readingHow to create an external table in BigQuery?
External table in BigQuery External Data Sources The data which is not stored in the BigQuery storage is called as
Continue readingDATE_ADD function in BigQuery with examples
DATE_ADD function in BigQuery DATE_ADD is a part of DATE function in BigQuery. It add a specified time interval to
Continue reading