[HTCondor-users] Singularity: bind-mounting scratch dir onto dedicated target mount fails

[Thomas Hartmann <thomas.hartmann@xxxxxxx>]

Hi all,


I see occasional problems for jobs started into Singularity containers
that the target bind-mount of the job's scratch dir is not writable [1].

Nominally, I am mounting scratch onto /srv in the container, where /srv
is existing as directory in the container (or is the target dir supposed
to be not existing in the container? Overlay is enabled for Singularity).

Cheers,
  Thomas

[1]
ESC[33mWARNING: Could not create mount point directory in container
/var/singularity/mnt/final/var/home/desyusr003: Operation not supported
ESC[0mESC[33mWARNING: Not mounting /tmp (already mounted in container)
ESC[0mESC[33mWARNING: Not mounting /var/tmp (already mounted in container)
ESC[0mmkdir: cannot create directory
`/mR6MDmgpudtn31DnJpCqFYppBe2THoABFKDmQwfKDmABFKDmzPU8Xm': Permission denied
mv: cannot move `././stest.sh' to
`mR6MDmgpudtn31DnJpCqFYppBe2THoABFKDmQwfKDmABFKDmzPU8Xm/.': No such file
or directory
/srv//condor_exec.exe: line 89:
/mR6MDmgpudtn31DnJpCqFYppBe2THoABFKDmQwfKDmABFKDmzPU8Xm.diag: Permission
denied
/srv//condor_exec.exe: line 94: cd:
/mR6MDmgpudtn31DnJpCqFYppBe2THoABFKDmQwfKDmABFKDmzPU8Xm: No such file or
directory
Failed to switch to
'/mR6MDmgpudtn31DnJpCqFYppBe2THoABFKDmQwfKDmABFKDmzPU8Xm'

btw: in the root namespace /home is a bind-mount to /var/home, where
pool accounts live.

Attachment: smime.p7s
Description: S/MIME Cryptographic Signature