Skip to main content

Data latency

Data latency in the console depends on the source's update cadence and DoiT's import schedule.

Cloud platforms​

PlatformProvider data freshnessDoiT refresh cadenceEnd-to-end latency
Alibaba CloudEvery 6 hoursWithin 30 hours
Amazon Web ServicesAWS updates Cost and Usage Reports (CUR) at least once a day.Every 6-8 hours after AWS updates the CUR file24 - 72 hours. See AWS cost data latency in the console.
Google CloudSee Google Cloud's frequency of data loads.Hourly24-72 hours
Microsoft AzureAzure Cost Management exports are updated daily.HourlyUp to 24 hours
Oracle Cloud InfrastructureOCI generates cost reports every six hours.Every 8 hours24-32 hours

Other integrations​

When you first connect a platform, DoiT immediately runs an initial data sync. The sync usually completes within a few hours, depending on the volume of historical data the source exposes. The cadence below applies after the initial sync.

PlatformDoiT refresh cadenceEnd-to-end latency
AivenEvery 6 hoursWithin 48 hours
Anthropic - Claude.aiEvery 6 hoursCost and usage: within 24–26 hours. Engagement metrics (active users, skills, connectors): at least 3 days
AnyscaleDailyWithin 48 hours
ClickHouse CloudEvery 6 hoursWithin 24-26 hours
CloudflareEvery 6 hoursWithin 48 hours
Confluent CloudEvery 6 hoursWithin 48 hours
CoralogixEvery 6 hoursWithin 24-26 hours
CursorEvery 6 hoursWithin 24-26 hours
Elastic CloudDailyWithin 48 hours
FastlyDailyWithin 48 hours
Fireworks AIEvery 6 hoursWithin 24-26 hours
GitHubEvery 6 hoursWithin 24-26 hours
Grafana CloudDailyWithin 48 hours
LinodeDailyWithin 48 hours
NebiusEvery 6 hoursWithin 24-26 hours
New RelicDailyWithin 48 hours
OpenRouterEvery 6 hoursWithin 24-26 hours
PlanetScaleDailyWithin 48 hours
Temporal CloudEvery 6 hoursWithin 24-26 hours
TwilioDailyWithin 48 hours
VercelEvery 6 hoursWithin 24-26 hours

Data cloud platforms​

PlatformDoiT refresh cadence
DatabricksMultiple times daily
SnowflakeEvery 12 hours

DataHub​

Data sent to DoiT through DataHub is available in the console within about 15 minutes of ingestion, regardless of the format.

See also​