<div dir="ltr"><div dir="ltr"><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small;color:#000000">Hi,</div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small;color:#000000"><br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small;color:#000000">Not an expert, but I did see negotiation issues from time to time, and it sounds like one.</div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small;color:#000000">What does your NegotiatorLog say?<br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small;color:#000000">It will be located in LOG (condor_config_val LOG) - usually /var/log/condor/NegotiatorLog</div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small;color:#000000">Try Going over a single negotiation cycle (starts with ---------- Started Negotiation Cycle ----------) </div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small;color:#000000">Usually, you can found the issue in a reasonable effort (if not, try adding D_FULLDEBUG to NEGOTIATOR_DEBUG variable).</div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small;color:#000000"><br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small;color:#000000">Ido</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Jul 27, 2020 at 4:48 PM Vipul Davda <<a href="mailto:vipul.davda@physics.ox.ac.uk">vipul.davda@physics.ox.ac.uk</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"> <div> <font face="Calibri" size="2"><span style="font-size:11pt"> <div>Hello,</div> <div> </div> <div>Over the weekend, I upgraded condor manager from 8.6.x to 8.8.9. The worker nodes are on version 8.8.8. </div> <div> </div> <div>After the upgrade, I cannot get any of jobs running. </div> <div> </div> <div style="padding-left:36pt"><font face="Courier New"># condor_q -better 1329761</font></div> <div style="padding-left:36pt"><font face="Courier New"> </font></div> <div style="padding-left:36pt"><font face="Courier New"> </font></div> <div style="padding-left:36pt"><font face="Courier New">The Requirements expression for job 1329761.000 is</font></div> <div style="padding-left:36pt"><font face="Courier New"> </font></div> <div style="padding-left:36pt"><font face="Courier New"> (TARGET.Arch == "X86_64") && (TARGET.OpSys == "LINUX") && (TARGET.Disk >= RequestDisk) && (TARGET.Memory >= RequestMemory) &&</font></div> <div style="padding-left:36pt"><font face="Courier New"> ((TARGET.FileSystemDomain == MY.FileSystemDomain) || (TARGET.HasFileTransfer))</font></div> <div style="padding-left:36pt"><font face="Courier New"> </font></div> <div style="padding-left:36pt"><font face="Courier New">Job 1329761.000 defines the following attributes:</font></div> <div style="padding-left:36pt"><font face="Courier New"> </font></div> <div style="padding-left:36pt"><font face="Courier New"> DiskUsage = 1</font></div> <div style="padding-left:36pt"><font face="Courier New"> FileSystemDomain = "<a href="http://int10.physics.ox.ac.uk" target="_blank">int10.physics.ox.ac.uk</a>"</font></div> <div style="padding-left:36pt"><font face="Courier New"> RequestDisk = DiskUsage</font></div> <div style="padding-left:36pt"><font face="Courier New"> RequestMemory = 3000</font></div> <div style="padding-left:36pt"><font face="Courier New"> </font></div> <div style="padding-left:36pt"><font face="Courier New">The Requirements expression for job 1329761.000 reduces to these conditions:</font></div> <div style="padding-left:36pt"><font face="Courier New"> </font></div> <div style="padding-left:36pt"><font face="Courier New"> Slots</font></div> <div style="padding-left:36pt"><font face="Courier New">Step Matched Condition</font></div> <div style="padding-left:36pt"><font face="Courier New">----- -------- ---------</font></div> <div style="padding-left:36pt"><font face="Courier New">[0] 67 TARGET.Arch == "X86_64"</font></div> <div style="padding-left:36pt"><font face="Courier New">[1] 67 TARGET.OpSys == "LINUX"</font></div> <div style="padding-left:36pt"><font face="Courier New">[3] 67 TARGET.Disk >= RequestDisk</font></div> <div style="padding-left:36pt"><font face="Courier New">[5] 67 TARGET.Memory >= RequestMemory</font></div> <div style="padding-left:36pt"><font face="Courier New">[8] 67 TARGET.HasFileTransfer</font></div> <div style="padding-left:36pt"><font face="Courier New"> </font></div> <div style="padding-left:36pt"><font face="Courier New"> </font></div> <div style="padding-left:36pt"><font face="Courier New">1329761.000: Job has not yet been considered by the matchmaker.</font></div> <div style="padding-left:36pt"><font face="Courier New"> </font></div> <div style="padding-left:36pt"><font face="Courier New"> </font></div> <div style="padding-left:36pt"><font face="Courier New">1329761.000: Run analysis summary ignoring user priority. Of 25 machines,</font></div> <div style="padding-left:36pt"><font face="Courier New"> 0 are rejected by your job's requirements</font></div> <div style="padding-left:36pt"><font face="Courier New"> 1 reject your job because of their own requirements</font></div> <div style="padding-left:36pt"><font face="Courier New"> 0 match and are already running your jobs</font></div> <div style="padding-left:36pt"><font face="Courier New"> 0 match but are serving other users</font></div> <div style="padding-left:36pt"><font face="Courier New"> 24 are able to run your job</font></div> <div> </div> <div>I skimmed trough mailing list posts and various documentation sources and I could not find anything that could help. </div> <div> </div> <div><font face="Calibri">Any help is much appreciated.</font></div> <div> </div> <div>Regards</div> <div>Vip</div> <div> </div> <div> </div> <div> </div> </span></font> </div> _______________________________________________<br> HTCondor-users mailing list<br> To unsubscribe, send a message to <a href="mailto:htcondor-users-request@cs.wisc.edu" target="_blank">htcondor-users-request@cs.wisc.edu</a> with a<br> subject: Unsubscribe<br> You can also unsubscribe by visiting<br> <a href="https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users" rel="noreferrer" target="_blank">https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users</a><br> <br> The archives can be found at:<br> <a href="https://lists.cs.wisc.edu/archive/htcondor-users/" rel="noreferrer" target="_blank">https://lists.cs.wisc.edu/archive/htcondor-users/</a></blockquote></div></div>