Re: [HTCondor-users] How to volume mount condor docker universe to current directory ?

["Dan, Bowen" <bowen.dan@xxxxxxxx>]

Hi Greg,

 

I meant the current directory on the execute machine, sorry that my question wasnât clear before, I am very new to condor.

 

The Docker command looks like this on execute machine:

 

/usr/bin/docker run --cpu-shares=10 --memory=4608m --cap-drop=all --hostname condor-7519.0-ip-xx-xxx-xxx-xx.localdomain --name HTCJob7519_0_slot1_1_PID199288 -e TEMP=/disk-root/condor/execute/dir_199288 -e _CONDOR_SCRATCH_DIR=/disk-root/condor/execute/dir_199288 -e _CONDOR_SLOT=slot1_1 -e BATCH_SYSTEM=HTCondor -e TMPDIR=/disk-root/condor/execute/dir_199288 -e _CONDOR_CHIRP_CONFIG=/disk-root/condor/execute/dir_199288/.chirp.config -e _CONDOR_JOB_PIDS= -e TMP=/disk-root/condor/execute/dir_199288 -e OMP_NUM_THREADS=1 -e _CONDOR_JOB_AD=/disk-root/condor/execute/dir_199288/.job.ad -e _CONDOR_JOB_IWD=/disk-root/condor/execute/dir_199288 -e _CHIRP_DELAYED_UPDATE_PREFIX=Chirp* -e _CONDOR_MACHINE_AD=/disk-root/condor/execute/dir_199288/.machine.ad --volume /disk-root/condor/execute/dir_199288:/disk-root/condor/execute/dir_199288 --volume /rcp-dfs:/data --volume /etc/rcp.json:/etc/rcp.json --volume /etc/bf-production.cfg:/etc/bf-production.cfg --volume /opt:/opt --workdir /disk-root/condor/execute/dir_199288 --user 65534:65534 hdr_test:latest /app/bin/HDRPipeline/Session/StartPipelineSession.py --session_setting=00.generation.json

 

 

The Condor local config file on the execute machine looks like this:

 

DAEMON_LIST = MASTER

DAEMON_LIST = $(DAEMON_LIST), STARTD, STARTER

DOCKER_VOLUMES = EFS

DOCKER_VOLUME_DIR_EFS = /rcp-dfs:/rcp-dfs

DOCKER_MOUNT_VOLUMES = EFS

CONDOR_HOST = xx-xxx-xxx-xx

 

 

I was wondering if the highlighted path above /disk-root/condor/execute/dir_199288 was somehow exposed to the Condor local config  file before Docker run kicks off  so that I can add another mount point as

 

DOCKER_VOLUMES = dir_199288

DOCKER_MOUNT_VOLUMES = /disk-root/condor/execute/dir_199288:/data

DOCKER_MOUNT_VOLUMES = dir_199288

 

 

if the above is not possible, is there a way to get $PWD inside the config file?

 

 

 

 

Respectfully,

Bowen

 

 

 

From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Greg Thain <gthain@xxxxxxxxxxx>
Reply-To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Date: Wednesday, July 5, 2017 at 2:01 PM
To: "htcondor-users@xxxxxxxxxxx" <htcondor-users@xxxxxxxxxxx>
Subject: Re: [HTCondor-users] How to volume mount condor docker universe to current directory ?

 

On 07/05/2017 11:48 AM, Dan, Bowen wrote:

Hi, 

 

I am trying o run a docker through docker universe and I was wondering if there is a way for me to volume mount current directory?

I have tried DOCKER_VOLUME_DIR_EXECUTE =  $(PWD):/data, but it does not work.

 

Do you mean the current directory on the submit machine to the execute machine?  If there is not shared filesystem between the two, this can't be done, docker volume mounts are only within one machine.

-greg