Connect Confluent Cloud
Confluent Cloud is a fully managed, cloud-native data streaming platform built on Apache Kafka. The Confluent Cloud integration imports your billing and cost data into DoiT Cloud Intelligence so you can analyze Confluent spending in Cloud Analytics.
Prerequisitesโ
- A Confluent Cloud account with BillingAdmin role on the organization.
- A DoiT account with the Billing Profiles Admin permission.
Required credentialsโ
| Field | Description | Where to find it |
|---|---|---|
| Organization ID | Your Confluent Cloud organization ID (e.g. org-xxxxx) | Confluent Cloud console โ Administration โ Organization |
| Cloud API Key | API key in key:secret format with BillingAdmin role | Confluent Cloud console โ Administration โ Cloud API keys |
Create a Cloud API keyโ
-
Sign in to Confluent Cloud.
-
Navigate to Administration โ Cloud API keys.
-
Select Add key.
-
Create or select a service account and assign the BillingAdmin role to it.
-
Copy the Key and Secret, and combine them as
key:secret.CautionThe secret is only shown once. Make sure to copy it before closing the dialog.
Connect your Confluent Cloud accountโ
-
Sign in to DoiT Cloud Intelligence, navigate to Data ingestion and integrations โ Assets.
-
Select Confluent Cloud from the left-hand menu, and then select Connect new account.
-
Enter your Organization ID and Cloud API Key (in
key:secretformat). -
Select Test connection to verify DoiT can access your Confluent billing data.
-
If the test is successful, select Save to complete the setup.
If the test fails or you need further assistance, please open an expert inquiry.
Upon initial connection, DoiT ingests your historical billing data. The import process can take a few hours. You'll receive an email when the data is available in Cloud Analytics.
Data refreshโ
DoiT refreshes your Confluent Cloud billing data every 6 hours. Data typically becomes available within 48 hours of being generated by Confluent.
Reporting dimensionsโ
Once connected, Confluent Cloud data maps to the following standard Cloud Analytics dimensions:
| Cloud Analytics dimension | Confluent value | Example |
|---|---|---|
| Provider | Confluent Cloud | Confluent Cloud |
| Billing Account | Organization ID | org-abc12 |
| Project/Account ID | Resource ID | lkc-ab1cd |
| Service | Product name | Kafka, Connect, ksqlDB |
| SKU | Line type | KAFKA_NUM_CKUS, CONNECT_NUM_TASKS |
In addition to standard dimensions, the following Confluent-specific labels are available:
| Label | Description |
|---|---|
| Service | Confluent product (e.g. Kafka, Connect, ksqlDB) |
| Category | Billing line type |
| Resource | Resource display name |
| Environment | Confluent environment ID |
Delete your Confluent Cloud connectionโ
-
Sign in to DoiT Cloud Intelligence, navigate to Data ingestion and integrations โ Assets.
-
Select Confluent Cloud from the left-hand menu.
-
Select the three dots menu (โฎ) at the rightmost end of the account you want to remove and select Delete.
-
Select Delete to confirm.