We apologize for the instability of composr.app and appreciate your patience. We are working on the statistics addon and trying to find an optimal way to store and render data. Unfortunately, we have yet to find a solution that can handle the traffic (and therefore, tens of millions of statistical records) of composr.app. We're working hard on one.
Topic #5625 (no title)
This is a spacer post for a website comment topic. The content this topic relates to: N/A
System message - Issue updated
By PDStig,
By PDStig,
posted
The details or status of this tracker issue were updated by PDStig
I am still monitoring. However, this is what I did:
Buckets are stored in a time interval according to the pivot
Cron runs every 15 minutes instead of every day (or every minute if we need to catch up)
Cron terminates after 15 seconds of processing or if memory use is getting high
Cron tracks the processing of each stats hook individually
Added a "delta"; when the stats hooks run, deltas are stored in a separate table instead of loading in current data (this saves on memory). Then, the Cron will merge the deltas batch by batch.
I'm still worried about the flat data because the flat data is still stored as one large set (and does not use deltas).
System message - Issue updated
I'm still worried about the flat data because the flat data is still stored as one large set (and does not use deltas).