Skip to main content

Connect Confluent Cloud

Confluent Cloud is a fully managed, cloud-native data streaming platform built on Apache Kafka. The Confluent Cloud integration imports your billing and cost data into DoiT Cloud Intelligence so you can analyze Confluent spending in Cloud Analytics.

Prerequisitesโ€‹

  • A Confluent Cloud account with BillingAdmin role on the organization.
  • A DoiT account with the Billing Profiles Admin permission.

Required credentialsโ€‹

FieldDescriptionWhere to find it
Organization IDYour Confluent Cloud organization ID (e.g. org-xxxxx)Confluent Cloud console โ†’ Administration โ†’ Organization
Cloud API KeyAPI key in key:secret format with BillingAdmin roleConfluent Cloud console โ†’ Administration โ†’ Cloud API keys

Create a Cloud API keyโ€‹

  1. Sign in to Confluent Cloud.

  2. Navigate to Administration โ†’ Cloud API keys.

  3. Select Add key.

  4. Create or select a service account and assign the BillingAdmin role to it.

  5. Copy the Key and Secret, and combine them as key:secret.

    Caution

    The secret is only shown once. Make sure to copy it before closing the dialog.

Connect your Confluent Cloud accountโ€‹

  1. Sign in to DoiT Cloud Intelligence, navigate to Data ingestion and integrations โ†’ Assets.

  2. Select Confluent Cloud from the left-hand menu, and then select Connect new account.

  3. Enter your Organization ID and Cloud API Key (in key:secret format).

  4. Select Test connection to verify DoiT can access your Confluent billing data.

  5. If the test is successful, select Save to complete the setup.

    If the test fails or you need further assistance, please open an expert inquiry.

Note

Upon initial connection, DoiT ingests your historical billing data. The import process can take a few hours. You'll receive an email when the data is available in Cloud Analytics.

Data refreshโ€‹

DoiT refreshes your Confluent Cloud billing data every 6 hours. Data typically becomes available within 48 hours of being generated by Confluent.

Reporting dimensionsโ€‹

Once connected, Confluent Cloud data maps to the following standard Cloud Analytics dimensions:

Cloud Analytics dimensionConfluent valueExample
ProviderConfluent CloudConfluent Cloud
Billing AccountOrganization IDorg-abc12
Project/Account IDResource IDlkc-ab1cd
ServiceProduct nameKafka, Connect, ksqlDB
SKULine typeKAFKA_NUM_CKUS, CONNECT_NUM_TASKS

In addition to standard dimensions, the following Confluent-specific labels are available:

LabelDescription
ServiceConfluent product (e.g. Kafka, Connect, ksqlDB)
CategoryBilling line type
ResourceResource display name
EnvironmentConfluent environment ID

Delete your Confluent Cloud connectionโ€‹

  1. Sign in to DoiT Cloud Intelligence, navigate to Data ingestion and integrations โ†’ Assets.

  2. Select Confluent Cloud from the left-hand menu.

  3. Select the three dots menu (โ‹ฎ) at the rightmost end of the account you want to remove and select Delete.

  4. Select Delete to confirm.