GCP

9 min

Here are the steps to manually set up your GCP integration with Amberflo. To enable GCP billing integration with Amberflo, you will configure a BigQuery export of your billing data and grant Amberflo the necessary access. Follow the steps below to complete the setup.

Setup Steps

Step 1. Create a New GCP Project

Visit the Google Cloud Resource Manager and create a new GCP project.

Link this new project to the billing account that your other GCP projects use.
Creating a new project is optional but recommended for easier access control.
Make a note of the Project ID. You’ll need it in later steps.

Step 2. Create a BigQuery Dataset

In the BigQuery console, create a dataset within the project you just created.

This dataset will hold your GCP billing data.
It is recommended to create one dataset per billing account to simplify deduplication.
Record the Dataset ID for later.

Step 3. Create a Custom IAM Role for Amberflo

Go to the IAM Roles page and create a new custom role with the following permissions:

bigquery.datasets.get
bigquery.jobs.create
bigquery.tables.export
bigquery.tables.get
bigquery.tables.getData
bigquery.tables.list

This role will allow Amberflo to access the exported billing data.

Step 4. Grant the Custom Role to Amberflo

Next, go to the IAM Admin page and assign the custom role to the Amberflo service account at the project level.

[email protected]

Step 5. Enable GCP Billing Export to BigQuery

Visit the Billing Export page and enable the export of billing data to BigQuery.

Make sure to enable both Detailed Usage Cost and Pricing.
Use the Project ID and Dataset ID from earlier.
This step is required to make your billing data available in BigQuery.

Step 6. Wait for Data to Appear in BigQuery

It can take up to a few days for the billing data export to be fully configured and available. Once active, BigQuery will create tables in your dataset such as:

gcp_billing_export_resource_v1_<billing_account_id>
cloud_pricing_export

You can monitor progress in the Cloud Resource Manager, BigQuery, and IAM console.

Step 7. Find your GCP Billing Account ID

A Google Cloud Platform (GCP) Billing Account ID is an 18-character, system-generated alphanumeric value, formatted like 010101-F0FFF0-10XX01

Where to Find Your Billing Account ID:

Go to the Google Cloud console.
Navigate to the billing section to find your billing account.
The billing account ID will be displayed there.

Once the export is active, send the following information to Amberflo:

The Project ID and Dataset ID
Your GCP Billing Account ID

These details are required to complete the integration and begin ingesting your billing data.

GCP