Re: [HTCondor-users] Questions concerning the submit file

[Nikolaos Tasios <nikolaos.tasios.e3mlab@xxxxxxxxxxx>]

Dear Todd,

 Thank you a lot for your explanatory answer.  However, i want to ask some further questions concerning my second point.

 Ihave noticed that each slot in the execute machine has one core-CPU and specific memory reserved.   

  Ideally what i want to do is the following. I want to define from the submit file of each job the number of cores-CPUs of the execute machine that a specific job will use as well as the number of MBs of memory of the execute machine.

  Usage of e.g. "request_CPUS>3" makes my job to stay idle and not run as there is no slot with multiple CPUs. 

   Can you please help me how to find a solution ?

  Thank you again for the support,

Best,

Nikos 

---

From: Todd Tannenbaum <tannenba@xxxxxxxxxxx>
Sent: Thursday, April 18, 2019 7:29 PM
To: HTCondor-Users Mail List; Nikolaos Tasios
Subject: Re: [HTCondor-users] Questions concerning the submit file

 

On 4/18/2019 10:53 AM, Nikolaos Tasios wrote:
> Hello Condor community,
>
> I want to ask the following questions:
> 1) how can i instruct the condor scheduler in the submit file to assign
> a specific job in a specific computer?

See https://htcondor-wiki.cs.wisc.edu/index.cgi/wiki?p=HowToAddJobReq

> 2) how can i assign specific computer resources (like number of CPus and
> memory) at a specific job?

In your job submit file, set request_cpus and request_memory.  This tells HTCondor
how many resources to allocate on a server for you job, and the remaining resources
on the server can go to other jobs.

Or perhaps you want to know how and administer of a server in a HTCondor cluster
can reserve resources on a server to only run specific types of jobs?  Is so see:

https://htcondor-wiki.cs.wisc.edu/index.cgi/wiki?p=HowToReserveSlotForSpecialJobs


> 3) how can i instruct the condor scheduler through the submit file to
> copy a whole folder from the submit machine to execute machine?
>

Just list the name of the folder (subdirectory) in your transfer_input_files, which will move
the directory and its contents into the scratch working directory on the execute node.
If you just want the contents of the folder, put a trailing slash on the name of
the subdirectory name.

Details and examples are in the manual at
 
  http://research.cs.wisc.edu/htcondor/manual/current/SubmittingaJob.html#x17-380002.5.9
 
Also see the condor_submit man page ("man condor_submit"), also available online at
  http://research.cs.wisc.edu/htcondor/manual/current/Condorsubmit.html
You want to looks at transfer_input_files.

Hope the above helps,
Todd