{"id":9295,"date":"2026-10-05T05:05:52","date_gmt":"2026-10-05T05:05:52","guid":{"rendered":"https:\/\/prwatech.in\/blog\/?p=9295"},"modified":"2026-10-07T14:59:32","modified_gmt":"2026-10-07T14:59:32","slug":"creating-cloud-composer","status":"publish","type":"post","link":"https:\/\/prwatech.in\/blog\/google-cloud-platform\/instance\/creating-cloud-composer\/","title":{"rendered":"Creating Cloud Composer"},"content":{"rendered":"\r\n

Creating a Cloud Composer Environment<\/h1>\r\n

Cloud Composer<\/b><\/strong>\u00a0is Google Cloud’s managed Apache Airflow. Airflow is the tool that schedules and runs workflows made of many steps, called DAGs, and Composer runs it for you. An environment<\/b><\/strong>\u00a0is one managed Airflow setup, with its own web interface, scheduler, workers, database, and a Cloud Storage bucket where you put your DAG files. Google’s documentation now sometimes calls the product Managed Service for Apache Airflow.<\/p>\r\n

Two things matter before you create one. The version, because the steps in older guides, including the original version of this page, are for Composer 1, which is past its end of life date. And the cost, because an environment bills for every hour it exists, whether or not a single DAG is running.<\/p>\r\n

This walks through creating a Composer 3 environment in the console, with the choices that actually matter explained at the steps where you make them, followed by what it costs and what to do next.<\/p>\r\n

Which Composer Version to Use<\/h2>\r\n
\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n
Cloud Composer version status<\/caption>\r\n
Version<\/th>\r\nStatus according to Google’s documentation<\/th>\r\n<\/tr>\r\n<\/thead>\r\n
Cloud Composer 1<\/th>\r\nCould no longer be created in the console from July 15, 2024. New environments could not be created at all from September 15, 2025. End of life date was September 15, 2026.<\/td>\r\n<\/tr>\r\n
Cloud Composer 2, versions 2.0.x<\/th>\r\nEnd of life date was September 15, 2026.<\/td>\r\n<\/tr>\r\n
Cloud Composer 2, versions 2.1.x and later<\/th>\r\nStill supported and not affected by that date.<\/td>\r\n<\/tr>\r\n
Cloud Composer 3<\/th>\r\nThe version Google recommends migrating to, and the one new environments should use.<\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<\/div>\r\n

If you find an older guide that asks for a node count and machine type, it is describing Composer 1. The Working With Composer Using Airflow guide in this series covers the same end of life change and what it means for that tutorial.<\/p>\r\n

Step by Step Process of Creating Cloud Composer<\/h2>\r\n

Step One: Open Composer<\/h3>\r\n

Open the console, then Open Menu > Composer<\/p>\r\n\r\n\r\n\r\n\r\n\r\n

\"\"<\/figure>\r\n\r\n\r\n\r\n

Step Two: Enable the API<\/h3>\r\n

Click Enable to turn on the Cloud Composer API.<\/p>\r\n\r\n\r\n\r\n

\"\"<\/figure>\r\n\r\n\r\n\r\n

Step Three: Create an Environment<\/h3>\r\n

Click Create environment, and choose Cloud Composer 3 if you are offered a choice of version.<\/p>\r\n\r\n\r\n\r\n

\"\"<\/figure>\r\n\r\n\r\n\r\n

Step Four: Name It and Choose a Location<\/h3>\r\n

Give the environment a name and choose a location, which is a region. The original page called this a cluster, but what you are creating is an Airflow environment, and its name is what you will see in the console and in commands later.<\/p>\r\n\r\n\r\n\r\n

\"\"<\/figure>\r\n\r\n\r\n\r\n

Step Five: Choose the Image Version, Size, and Service Account<\/h3>\r\n

The original page asks for a node count, a zone, and a machine type here. A current environment asks for different things. Choose an image version, which is the Composer and Airflow version it runs, and choose an environment size, which is small, medium, or large. Small is the right choice for learning. Choose a service account for the environment to run as.<\/p>\r\n

Google recommends a user managed service account with only the permissions the environment and your DAGs need, rather than a broad default account. The Composer Worker role covers what is needed in most cases, and you should add further permissions only when a DAG actually requires them. The GCP Service Account guide in this series explains why narrow permissions matter.<\/p>\r\n\r\n\r\n\r\n

\"\"<\/figure>\r\n\r\n\r\n\r\n

Step Six: Click Create<\/h3>\r\n

Click Create. Google gives the approximate time to create an environment as 25 minutes, so the original page’s little bit of time is longer than it sounds. You can watch the status in the environments list.<\/p>\r\n\r\n\r\n\r\n

\"\"<\/figure>\r\n\r\n\r\n\r\n

What an Environment Costs<\/h2>\r\n

Google bills Composer for the time an environment exists. Its own pricing example makes the point, if you create an environment, run it for 6 hours and 30 minutes, and delete it, you pay for 6.5 hours. Deleting the environment is what stops the charges. Composer 3 is billed in DCU hours, a unit of compute, at 0.06 US dollars per DCU hour in Iowa, plus database storage, and your environment also has costs that are not part of Composer pricing, such as the Cloud Storage bucket and network traffic.<\/p>\r\n

Google’s pricing page gives rates and examples rather than a single monthly figure, and one published measurement of a small Composer 3 environment doing nothing came to about 12.58 US dollars a day, roughly 400 dollars a month. Treat that as an order of magnitude, not a quote, and check Google’s pricing page and calculator. At that rate, a 300 dollar free trial credit would last under a month, so delete practice environments as soon as you finish.<\/p>\r\n

After the Environment Is Created<\/h2>\r\n

Each environment gets an Airflow web interface and a Cloud Storage bucket for DAG files. You add a DAG by placing its file in the bucket, and Airflow picks it up. The Working With Composer Using Airflow guide in this series walks through running a DAG.<\/p>\r\n

Common Mistakes to Avoid<\/h2>\r\n