#5655 - Scheduler locked out on infinite loop / out of memory on index_download

By PDStig
Added 30th Mar 2024, 6:17 PM
30 views

Identifier	#5655
Issue type	Minor issue (breaks specific functionality)
Title	Scheduler locked out on infinite loop / out of memory on index_download
Status	Completed
Handling member	PDStig
Addon	General / Uncategorised
Description	I'm not sure what's going on but the scheduler on composr.app is locked out. Cron just exits without doing anything (no logs). Logging page bails on 500 out of memory. Only affecting composr.app at this time.
Steps to reproduce
Funded?	No

The system will post a comment when this issue is modified (e.g., status changes). To be notified of this, click "Enable comment notifications".

Rating

Unrated

Comments

By Guest posted 30th Mar 2024, 6:21 PM

It's index_download task causing the lock-out. Probably a bug that exists elsewhere too.

The out of memory is because there are 8,000+ tasks pending. We should implement the safe limit on task display.

By Guest posted 30th Mar 2024, 7:47 PM

index_download is a separate issue. The primary issue was that there were a bunch of tasks... I had to do the following:

* Don't show a table if there are more than 300 tasks queued
* Only process 50 tasks at a time per Cron cycle (TODO: config option)