Skip to main content

Connect Pinecone

Pinecone is a managed vector database and AI inference platform for building search, retrieval-augmented generation (RAG), and recommendation workloads. The Pinecone integration imports your daily FOCUS v1.4 cost and usage reports into Cloud Intelligence™ so you can analyze your vector database, collections, embeddings, and support spend in Cloud Analytics.

Prerequisites​

  • A Pinecone organization on the Enterprise plan (cost and usage reports require a Pinecone Enterprise plan).
  • Organization Owner access in the Pinecone console to create a service account with the Billing Admin or Organization Owner role.
  • A DoiT account with the Billing Profiles Admin permission.

Required credentials​

FieldDescriptionWhere to find it
Organization IDYour Pinecone Organization ID (UUID)Pinecone console > Settings > General (e.g., 00000000-0000-4000-8000-000000000001)
Service Account Client IDThe OAuth 2.0 client_id of your Pinecone service accountPinecone console > Settings > Service Accounts
Service Account Client SecretThe OAuth 2.0 client_secret of your Pinecone service accountDisplayed once when creating the service account in the Pinecone console
Required service account role

Your Pinecone service account must have the Billing Admin (recommended, least privilege) or Organization Owner role.

Both DoiT's onboarding connection check (GET /admin/cost-usage-exports?limit=1) and scheduled billing ingestion (POST /admin/cost-usage-exports and GET /admin/cost-usage-exports/{export_id}) use Pinecone's Admin API cost and usage export endpoints, which require Billing Admin or Organization Owner permissions.

Create a Pinecone service account​

  1. Sign in to the Pinecone console.

  2. Go to Settings > Service Accounts.

  3. Select Create Service Account.

  4. Enter a name (for example, doit-cloud-intelligence) and assign the Billing Admin role.

  5. Select Create and copy both the Client ID and Client Secret.

    Caution

    The Client Secret is only displayed once upon creation. Copy and store it securely before closing the dialog.

Connect your Pinecone organization​

  1. Sign in to Cloud Intelligence, select Data ingestion and integrations > Integrations from the top navigation mega menu.

  2. Search for Pinecone in the integrations catalog.

  3. Select Connect + on the integration card.

  4. Enter your Organization ID, Service Account Client ID, and Service Account Client Secret.

  5. Select Test connection to verify DoiT can authenticate and access your Pinecone cost and usage exports.

  6. If the test is successful, select Save to complete the setup.

    If the test fails or you need further assistance, please open an expert inquiry.

Note
  • One connection per Pinecone organization: Connect only once per Pinecone organization. Each export contains cost and usage across all projects (SubAccountId), indexes, and collections in the organization; connecting the same organization multiple times will duplicate costs.
  • Rolling 30-day export window: Pinecone's Admin API generates a rolling 30-day FOCUS v1.4 export on each run. Upon initial connection, DoiT imports the past 30 days of historical cost and usage data, and retains daily history going forward in Cloud Analytics.

Data refresh​

DoiT refreshes your Pinecone cost and usage data twice daily (every 12 hours). Each run exchanges your service account credentials for a short-lived OAuth 2.0 bearer token (POST https://login.pinecone.io/oauth/token), triggers an asynchronous FOCUS v1.4 export (POST https://api.pinecone.io/admin/cost-usage-exports), polls until the archive is ready, and ingests all CSV parts from the resulting ZIP archive.

Pinecone updates usage data daily at approximately 08:00 UTC, with a typical 1–2 day lag for finalized daily charges. Because each export covers the trailing 30 days, DoiT automatically refreshes the trailing 30 daily partitions on every run so late-arriving usage or rating adjustments are reflected in Cloud Analytics.

Reporting dimensions​

Once connected, Pinecone data maps to the following standard Cloud Analytics dimensions:

Cloud Analytics dimensionPinecone FOCUS columnExample
ProviderProviderNamePinecone
Billing AccountBillingAccountId (or connection identifier)00000000-0000-4000-8000-000000000001
Project/Account IDSubAccountId (falls back to BillingAccountId for org-level charges)00000000-0000-4000-8000-000000000101
ServiceServiceNameDatabase, Collections, Inference, Support, Other
SKUSkuMeter (SkuId / ChargeDescription)read_units, write_units, storage_units, egress_gb, inference_embed_total_tokens
ResourceResourceId (ResourceName)prod-embeddings-idx
LocationRegionName (RegionId)us-central1, us-east-1, global
CostEffectiveCost (fallback to BilledCost / ContractedCost)$48.20
UsagePricingQuantity (fallback to ConsumedQuantity)102.31 (Units, GB-Hours, Tokens, GB)

In addition to standard dimensions, the following Pinecone-specific system labels are available under the pinecone/ prefix:

LabelDescription
pinecone/organization_idPinecone organization ID (x_OrganizationId)
pinecone/billing_account_namePinecone organization name (BillingAccountName)
pinecone/project_namePinecone project name (SubAccountName)
pinecone/resource_nameIndex or collection name (ResourceName)
pinecone/resource_typeResource type (index, collection)
pinecone/service_categoryFOCUS service category (Databases, AI and Machine Learning, Other)
pinecone/service_subcategoryFOCUS service subcategory (NoSQL Databases, AI Platforms)
pinecone/sku_meterMetered SKU type (read_units, write_units, storage_units, egress_gb, v3_collection_usage, inference_embed_total_tokens, minimum_usage, support_products)
pinecone/sku_price_idFOCUS SKU price identifier (SkuPriceId)
pinecone/charge_categoryFOCUS charge category (Usage, Purchase)
pinecone/charge_frequencyFOCUS charge frequency (Usage-Based, Recurring)
pinecone/pricing_categoryFOCUS pricing category (Standard, Dynamic)
pinecone/host_providerUnderlying cloud host provider (GCP, AWS, Azure)
pinecone/cloud_idPinecone cloud identifier (x_CloudId)
pinecone/regionDeployment region (RegionName)
genai/genai_spendAutomatically set to true on all Pinecone billing rows
genai/modelEmbedding or reranking model identifier extracted from ChargeDescription on Inference rows
genai/usage_typeNormalized inference usage type (embedding) on Inference embedding rows

Delete your Pinecone connection​

  1. Sign in to Cloud Intelligence, select Data ingestion and integrations > Integrations from the top navigation mega menu.

  2. Search for Pinecone in the integrations catalog.

  3. Select Manage on the integration card.

  4. Select the kebab menu (⋮) at the rightmost end of the organization you want to remove and select Delete.

  5. Select Delete to confirm.