[HTCondor-users] Error with the Docker universe

[Gaetan Geffroy <gage@xxxxxxxxx>]

Hi,

 

First of all, my setup for this is a bit peculiar. I am trying to put together an environment for CI testing a service which creates condor jobs using the Python client.

The tests are run with that service running in a Docker container, and I am using the htcondor/mini image to run Condor in another container.

 

This works fine for vanilla universe, but now I also want to test on the Docker universe. Here is what I have so far:

1. I launch the Condor container:
   docker run -it --network host --name condor --rm \
   -v /var/run/docker.sock:/var/run/docker.sock \
   htcondor/mini:9.0.16-el7
   Note that I give it access to the Docker of the host machine
2. Install the Docker client in the container and restart condor:
   yum install -y docker-client
   setfacl --modify user:condor:rw /var/run/docker.sock
   condor_restart
   At that point, I am able to start other containers from withing the Condor container
3. I try to run a basic Docker Universe job:
   universe                = docker
   docker_image            = python:3.8.10
   executable              = /usr/bin/echo
   arguments               = Bonjour
   output                  = test_docker.out
   error                   = test_docker.err
   log                     = test_docker.log
   request_memory          = 100M
   queue 1

The job is correctly submitted and picked by one of the workers, but then it immediately goes on hold with the following error:

Hold reason: Error from slot1@mymachine: Error response from daemon: Duplicate mount point: /var/lib/condor/execute/dir_1260

 

Does anyone know what could be causing this ?

 

Thanks,

Gaëtan Geffroy

 

Gaetan Geffroy
Junior Software Engineer, Space

Terma GmbH
Europaarkaden II, Bratustraße 7, 64293 Darmstadt, Germany
T +49 6151 86005 43 (direct)  •  T +49 6151 86005-0
Terma GmbH - Sitz Darmstadt  •  Handelsregister Nr.: HRB 7411, Darmstadt
Geschäftsführer: Poul Vigh / Steen Vejby Sørensen
www.terma.com • Linkedin • Twitter • Instagram • Youtube

---

Attention:
This e-mail (and attachment(s), if any) - intended for the addressee(s) only - may contain confidential, copyright, or legally privileged information or material, and no one else is authorized to read, print, store, copy, forward, or otherwise use or disclose any part of its contents or attachment(s) in any form. If you have received this e-mail in error, please notify me by telephone or return e-mail, and delete this e-mail and attachment(s). Thank you.