Data Rollups
Author: ajhollidCreated Aug 19, 2026Updated Sep 12, 2026
Historical data should be rolled up periodicially for retention
Considerations
- Checks are polymorphic, all data needs to be rolled up including PageSpeed and Infra data. Thus the rollup collection should be polymorphic as well, no need for multiple collections
- What granularity for rollups? Daily is probably sufficient. A daily rollup will serve all date ranges > 1 day. Ranges < 1 day can be query the Check collection directly. Something to consider here though is timezone. If rollups are daily, we'll lose local midnight and will be using UTC midnight. Hourly rollups can resolve this but are more expensive.
- Scheduling - How often should rollups be done? Once a day is probably sufficient if granularity is daily
- Backfill - What should happen if rollup data is insufficient for the given date range?
- Timezone - Server side operations should all be in UTC. Timezone is a client side consideration
Source: bluewave-labs/Checkmate