On 6/7/24 12:18, Vikrant Aggarwal wrote:
Thanks guys for the suggestions.We are already looking into the late materialization. Version update to newer versions like 23.x will take some time.We noticed this issue can happen with smaller batches as well.
One possibility is to throw hardware at the problem -- if the schedd's job_queue.log file isn't on a fast, local storage system, that will cause the whole scheduler to be slow.
-greg