Hanging batch jobs
Posted: October 9th, 2023, 3:41 pm
I'm having an issue for the auto apply receipts batch jobs while doing load testing.
I have it set up for a parent batch job to populate a DB table that I use as a Queue. Multiple worker jobs then pick from the queue to process them in parallel.
When the worker job reaches ~350-400 records processed, it starts to just hang. The worker batch job will be stuck running but it's not processing any records anymore. Also, the work with batch jobs screen becomes unresponsive when a job goes into this state (504 gateway error).
For now, I've set up a work around where the worker jobs only process 50 records then ends. The parent job constantly monitors for records in the queue to restart the worker batch jobs.
I have it set up for a parent batch job to populate a DB table that I use as a Queue. Multiple worker jobs then pick from the queue to process them in parallel.
When the worker job reaches ~350-400 records processed, it starts to just hang. The worker batch job will be stuck running but it's not processing any records anymore. Also, the work with batch jobs screen becomes unresponsive when a job goes into this state (504 gateway error).
For now, I've set up a work around where the worker jobs only process 50 records then ends. The parent job constantly monitors for records in the queue to restart the worker batch jobs.