Connect Pinecone
Pinecone is a managed vector database and AI inference platform for building search, retrieval-augmented generation (RAG), and recommendation workloads. The Pinecone integration imports your daily FOCUS v1.4 cost and usage reports into Cloud Intelligence™ so you can analyze your vector database, collections, embeddings, and support spend in Cloud Analytics.
Prerequisites
- A Pinecone organization on the Enterprise plan (cost and usage reports require a Pinecone Enterprise plan).
- Organization Owner access in the Pinecone console to create a service account with the Billing Admin or Organization Owner role.
- A DoiT account with the Billing Profiles Admin permission.
Required credentials
| Field | Description | Where to find it |
|---|---|---|
| Organization ID | Your Pinecone Organization ID (UUID) | Pinecone console > Settings > General (e.g., 00000000-0000-4000-8000-000000000001) |
| Service Account Client ID | The OAuth 2.0 client_id of your Pinecone service account | Pinecone console > Settings > Service Accounts |
| Service Account Client Secret | The OAuth 2.0 client_secret of your Pinecone service account | Displayed once when creating the service account in the Pinecone console |
Your Pinecone service account must have the Billing Admin (recommended, least privilege) or Organization Owner role.
Both DoiT's onboarding connection check (GET /admin/cost-usage-exports?limit=1) and scheduled billing ingestion (POST /admin/cost-usage-exports and GET /admin/cost-usage-exports/{export_id}) use Pinecone's Admin API cost and usage export endpoints, which require Billing Admin or Organization Owner permissions.
Create a Pinecone service account
-
Sign in to the Pinecone console.
-
Go to Settings > Service Accounts.
-
Select Create Service Account.
-
Enter a name (for example,
doit-cloud-intelligence) and assign the Billing Admin role. -
Select Create and copy both the Client ID and Client Secret.
CautionThe Client Secret is only displayed once upon creation. Copy and store it securely before closing the dialog.
Connect your Pinecone organization
-
Sign in to Cloud Intelligence, select Data ingestion and integrations > Integrations from the top navigation mega menu.
-
Search for Pinecone in the integrations catalog.
-
Select Connect + on the integration card.
-
Enter your Organization ID, Service Account Client ID, and Service Account Client Secret.
-
Select Test connection to verify DoiT can authenticate and access your Pinecone cost and usage exports.
-
If the test is successful, select Save to complete the setup.
If the test fails or you need further assistance, please open an expert inquiry.
- One connection per Pinecone organization: Connect only once per Pinecone organization. Each export contains cost and usage across all projects (
SubAccountId), indexes, and collections in the organization; connecting the same organization multiple times will duplicate costs. - Rolling 30-day export window: Pinecone's Admin API generates a rolling 30-day FOCUS v1.4 export on each run. Upon initial connection, DoiT imports the past 30 days of historical cost and usage data, and retains daily history going forward in Cloud Analytics.
Data refresh
DoiT refreshes your Pinecone cost and usage data twice daily (every 12 hours). Each run exchanges your service account credentials for a short-lived OAuth 2.0 bearer token (POST https://login.pinecone.io/oauth/token), triggers an asynchronous FOCUS v1.4 export (POST https://api.pinecone.io/admin/cost-usage-exports), polls until the archive is ready, and ingests all CSV parts from the resulting ZIP archive.
Pinecone updates usage data daily at approximately 08:00 UTC, with a typical 1–2 day lag for finalized daily charges. Because each export covers the trailing 30 days, DoiT automatically refreshes the trailing 30 daily partitions on every run so late-arriving usage or rating adjustments are reflected in Cloud Analytics.
Reporting dimensions
Once connected, Pinecone data maps to the following standard Cloud Analytics dimensions:
| Cloud Analytics dimension | Pinecone FOCUS column | Example |
|---|---|---|
| Provider | ProviderName | Pinecone |
| Billing Account | BillingAccountId (or connection identifier) | 00000000-0000-4000-8000-000000000001 |
| Project/Account ID | SubAccountId (falls back to BillingAccountId for org-level charges) | 00000000-0000-4000-8000-000000000101 |
| Service | ServiceName | Database, Collections, Inference, Support, Other |
| SKU | SkuMeter (SkuId / ChargeDescription) | read_units, write_units, storage_units, egress_gb, inference_embed_total_tokens |
| Resource | ResourceId (ResourceName) | prod-embeddings-idx |
| Location | RegionName (RegionId) | us-central1, us-east-1, global |
| Cost | EffectiveCost (fallback to BilledCost / ContractedCost) | $48.20 |
| Usage | PricingQuantity (fallback to ConsumedQuantity) | 102.31 (Units, GB-Hours, Tokens, GB) |
In addition to standard dimensions, the following Pinecone-specific system labels are available under the pinecone/ prefix:
| Label | Description |
|---|---|
pinecone/organization_id | Pinecone organization ID (x_OrganizationId) |
pinecone/billing_account_name | Pinecone organization name (BillingAccountName) |
pinecone/project_name | Pinecone project name (SubAccountName) |
pinecone/resource_name | Index or collection name (ResourceName) |
pinecone/resource_type | Resource type (index, collection) |
pinecone/service_category | FOCUS service category (Databases, AI and Machine Learning, Other) |
pinecone/service_subcategory | FOCUS service subcategory (NoSQL Databases, AI Platforms) |
pinecone/sku_meter | Metered SKU type (read_units, write_units, storage_units, egress_gb, v3_collection_usage, inference_embed_total_tokens, minimum_usage, support_products) |
pinecone/sku_price_id | FOCUS SKU price identifier (SkuPriceId) |
pinecone/charge_category | FOCUS charge category (Usage, Purchase) |
pinecone/charge_frequency | FOCUS charge frequency (Usage-Based, Recurring) |
pinecone/pricing_category | FOCUS pricing category (Standard, Dynamic) |
pinecone/host_provider | Underlying cloud host provider (GCP, AWS, Azure) |
pinecone/cloud_id | Pinecone cloud identifier (x_CloudId) |
pinecone/region | Deployment region (RegionName) |
genai/genai_spend | Automatically set to true on all Pinecone billing rows |
genai/model | Embedding or reranking model identifier extracted from ChargeDescription on Inference rows |
genai/usage_type | Normalized inference usage type (embedding) on Inference embedding rows |
Delete your Pinecone connection
-
Sign in to Cloud Intelligence, select Data ingestion and integrations > Integrations from the top navigation mega menu.
-
Search for Pinecone in the integrations catalog.
-
Select Manage on the integration card.
-
Select the kebab menu (⋮) at the rightmost end of the organization you want to remove and select Delete.
-
Select Delete to confirm.