Adding GCS file into BigQuery

  • date 29th May, 2021 |
  • by Prwatech |
  • 0 Comments

Prerequisites

GCP account

Download file by pressing the below link.

https://storage.googleapis.com/cloud-training/OCBL013/nyc_tlc_yellow_trips_2018_subset_1.csv

This is a google cloud training data.

Open Console.

Add the downloaded file into Bucket.

Open Menu > BigQuery.

Open the Project.

Click on Create Dataset.

Give dataset ID. Then click Create Dataset.

Click on Create Table.

Select Source as Google Cloud Storage. Click Browse.

Choose the file from bucket. Click Select

The File will be selected with file format.

Choose the Destination table.

Give project name, dataset name and table name.

Click on auto detect. Click create table.

The table will be added.

Paste your query in query editor.

SELECT

*

FROM

     gcs_bq.nyc_trips

ORDER BY

     Fare_amount DESC

LIMIT

10;

Click Run.The Query will be executed.

Paste your query in query editor.

SELECT

*

FROM

     gcs_bq.nyc_trips

WHERE

     EXTRACT(Month

          FROM

          Pickup_datetime)=1

ORDER BY

     fare_amount DESC

LIMIT

10;

Click Run.The Query will be executed.

Quick Support

image image