Re: [HTCondor-users] Submit requirements & ignoring significant attributes

[Todd Tannenbaum <tannenba@xxxxxxxxxxx>]

On 10/25/2016 10:34 AM, Frank Fischer wrote:
> Hi all,
>
> I'm facing some strange issues in my configuration file regarding
> auto-clustering/significant attributes and adding requirements upon job
> submission (in our setup we have a job route defined - we append
> requirements in order to make sure the router acts before the jobs starts)
>
> > APPEND_REQUIREMENTS = ( (INPUT_FILES =?= UNDEFINED) || (HPDA_Route =?=
> > TRUE) || (( CurrentTime - QDate ) > ( $(JOB_ROUTER_POLLING_PERIOD) * 3
> > )) )

So the real problem you are trying to solve is to prevent a job from 
running before the job_router acted on it.

I suggest you get rid of all your customization of 
SIGNIFICANT_ATTRIBUTES (you will need to do "condor_restart -fast" after 
this, a condor_reconfig is not enough), and get rid of references to 
CurrentTime and QDate in APPEND_REQUIREMENTS, and instead solve the real 
problem via one of two possibilities:

1. If you can run HTCondor v8.5 on your submit machine, perhaps you can 
use a "job transform" instead of using the job_router.  A "job 
transform" allows the admin to edit an incoming job classad, and is 
performed by the schedd BEFORE the job enters the queue.  See the manual 
at https://is.gd/5p3Wks or the ticket about this at
  https://htcondor-wiki.cs.wisc.edu/index.cgi/tktview?tn=5885

OR

2. If you want to do this via the job_router, you could add to your 
config something like
  JobWasRouted = False
  SUBMIT_ATTRS = $(SUBMIT_ATTRS) JobWasRouted
  APPEND_REQUIREMENTS = ( JobWasRouted =?= True )
and then in your route rule include
   set_JobWasRouted = True;
This way you achieve your goal without referencing QDate in your 
Requirements expression which, as you discovered, wreaks havoc with 
autoclustering.

Hope the above helps,
Todd


> The following configuration values (should) handle significant attributes:
>
> > # Round attributes (up) for better AutoClustering.
> > # 25%: 112 => 125, 1133 => 1250
> > # 3  : 112 => 1000, 1212 => 2000
> > SCHEDD_ROUND_ATTR_RequestWalltime = 3
> > SCHEDD_ROUND_ATTR_RequestMemory = 20%
> > SCHEDD_ROUND_ATTR_RequestDisk = 25%
> >
> > SIGNIFICANT_ATTRIBUTES = JobUniverse,WantDocker,\
> >                          RequestWalltime,\
> >                          RequestCpus,RequestMemory,RequestDisk,\
> >                          Requirements,\
> >                          RemoteJob,ExperimentalJob,\
> >                          HPDA_Route
> > REMOVE_SIGNIFICANT_ATTRIBUTES = DiskUsage, QDate
>
> So far so good.
>
> Now here's an example of condor_q -autocluster -long:
>
> > ServerTime = 1477408979
> > AutoClusterId = 2836
> > JobCount = 7
> > Requirements = ( ( TARGET.CLOUDSITE == "BWFORCLUSTER" ) ) && ( ( (
> > INPUT_FILES =?= undefined ) || ( HPDA_Route =?= true ) || ( (
> > CurrentTime - QDate ) > ( 10 * 3 ) ) ) ) && ( TARGET.Arch == "X86_64"
> > ) && ( TARGET.OpSys == "LINUX" ) && ( TARGET.Disk >= RequestDisk ) &&
> > ( TARGET.Memory >= RequestMemory ) && ( TARGET.HasFileTransfer )
> > RequestDisk = DiskUsage
> > JobIds = "175098.1 ... 175098.16"
> > JobUniverse = 5
> > RequestCpus = 1
> > DiskUsage = 750000
> > RequestWalltime = 69000
> > QDate = 1477393245
> > RemoteJob = true
> > RequestMemory = 4000
>
> Apparently QDate and DiskUsage are NOT removed from significant
> attributes, although I explicitly told HTCondor to do so.
>
> Am I missing something or do you see an error in my though process?
> I'm out of ideas, what I could try to increase the number of clustered
> jobs.
>
> Thanks & regards
> Frank
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/


--
Todd Tannenbaum <tannenba@xxxxxxxxxxx> University of Wisconsin-Madison
Center for High Throughput Computing   Department of Computer Sciences
HTCondor Technical Lead                1210 W. Dayton St. Rm #4257
Phone: (608) 263-7132                  Madison, WI 53706-1685