Re: [HTCondor-users] JobRouter unable to find job_queue.log when it's not in the spool directory

[Todd Tannenbaum <tannenba@xxxxxxxxxxx>]

On 4/1/2016 11:25 AM, Vladimir Brik wrote:
> > Ugh. Did you actually try it?
> I thought I did, but then I tried again this morning and now it works.
> Sorry about that, and thanks for the help!
>
> Vlad

Glad we could help, thanks for letting us know the outcome.  Hope to see 
you at HTCondor Week in May.

best
Todd


> On 03/31/16 12:02, Todd Tannenbaum wrote:
> > On 3/31/2016 9:54 AM, Vladimir Brik wrote:
> > > > SPOOL = /var/lib/condor/execute/spool
> > > > JOB_QUEUE_LOG = /ssd/job_queue.log
> > > > You could then do
> > > > JOB_ROUTER_SCHEDD1_SPOOL = /ssd
> > > This seems to break file spooling, since condor_ce_schedd still puts
> > > spool directories in /var/lib/condor/execute/spool but JobRouter is
> > > looking for them in /ssd.
> > >
> > >
> > > Vlad
> >
> > Ugh.  Did you actually try it?  If so, could you post the snippets
> > showing the errors from your JobRouter log file ?
> >
> > thanks
> > Todd
> >
> > > On 03/30/16 16:37, Todd Tannenbaum wrote:
> > > > On 3/30/2016 3:30 PM, Vladimir Brik wrote:
> > > > > Hello.
> > > > >
> > > > > After setting condor-ce's JOB_QUEUE_LOG to a location outside of SPOOL
> > > > > (so that job_queue.log is not clobbered if the spool filesystem fills
> > > > > up), JobRouter started to complain about being unable to open
> > > > > $(SPOOL)/job_queue.log.
> > > > >
> > > > > I see a config knob to tell JobRouter where the spool directory is,
> > > > > but
> > > > > not where the job_queue.log file is. Is it possible to make JobRouter
> > > > > work with job_queue.log that is outside of the spool directory?
> > > > >
> > > > > I am using condor 8.3.8.
> > > > >
> > > > > Thanks,
> > > > >
> > > > > Vlad
> > > >
> > > > Hi Vlad,
> > > >
> > > > I am not a JobRouter expert, but I think you can make things work with
> > > > v8.3.8 if you still called the file "job_queue.log", even if it now
> > > > lives in a different subdirectory than SPOOL.
> > > >
> > > > I think the trick is to use JOB_ROUTER_SCHEDD1_SPOOL knob (and
> > > > optionally also the JOB_ROUTER_SCHEDD2_SPOOL knob, depending on if you
> > > > are routing between two different schedds).   These knobs are
> > > > documented
> > > > in the v8.3.8 manual at http://is.gd/VZs8fi
> > > >
> > > > So I am guessing that  if you have something like
> > > >    SPOOL = /var/lib/condor/execute/spool
> > > >    JOB_QUEUE_LOG = /ssd/job_queue.log
> > > > You could then do
> > > >    JOB_ROUTER_SCHEDD1_SPOOL = /ssd
> > > >
> > > > Hope the above helps
> > > > Todd
> > > >
> > > >
> > > > _______________________________________________
> > > > HTCondor-users mailing list
> > > > To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx
> > > > with a
> > > > subject: Unsubscribe
> > > > You can also unsubscribe by visiting
> > > > https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
> > > >
> > > > The archives can be found at:
> > > > https://lists.cs.wisc.edu/archive/htcondor-users/
> > > _______________________________________________
> > > HTCondor-users mailing list
> > > To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx
> > > with a
> > > subject: Unsubscribe
> > > You can also unsubscribe by visiting
> > > https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
> > >
> > > The archives can be found at:
> > > https://lists.cs.wisc.edu/archive/htcondor-users/
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/


--
Todd Tannenbaum <tannenba@xxxxxxxxxxx> University of Wisconsin-Madison
Center for High Throughput Computing   Department of Computer Sciences
HTCondor Technical Lead                1210 W. Dayton St. Rm #4257
Phone: (608) 263-7132                  Madison, WI 53706-1685