How to concatenate columns in Spark dataframe?
Concatenate functions in Spark SQL The module pyspark.sql.functions provides two concatenate functions as below concat – It concatenates multiple input
Continue readingHow to convert Pandas dataframe to Spark dataframe?
Convert Pandas to Spark dataframe In some cases, we use Pandas library in Pyspark to perform the data analysis or
Continue readingHow to create Azure Synapse Analytics Workspace?
Azure Synapse Analytics Workspace It is a graphical user interface which allows us to work with all the components of
Continue readingWhat is Azure Synapse Analytics?
Azure Synapse Analytics Azure Synapse is an analytics service that brings data warehousing and big data analytics together. Analytics without
Continue readingHow to get the DDL of an existing table/view in BigQuery?
INFORMATION_SCHEMA in BigQuery The INFORMATION_SCHEMA views allows us to retrieve the metadata information about our BigQuery objects. It has list
Continue readingSplit function in BigQuery with examples
Split function in BigQuery Split is a part of String function in BigQuery which helps to split the value based
Continue readingHow to flatten an array using UNNEST function in BigQuery?
UNNEST function in BigQuery UNNEST is an array function in BigQuery which is used to flatten out an array. It
Continue readingHow to convert a String to Date in BigQuery?
CAST function in BigQuery Cast is a conversion function which is used to convert the given data type to different
Continue readingHow to submit a BigQuery job using Google Cloud Dataflow/Apache Beam?
Dataflow in GCP Dataflow in GCP offers simplified streaming and batch data processing service based on Apache Beam. It allows
Continue readingExtract function in Hive with examples
Extract function in Hive Extract function is used to get the date or time part values from a Date/Timestamp/Interval/String that
Continue reading