[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Docker in Condor



Hi,

One of my main concern with Docker is that either the sysadmin have to set up all the containers in advance (which would be a mess for a big number of users), or if the users are allowed to set up their own containers, that's a pretty big security concern (the users get *real* root within the containers, and if the can control the mount points it's trivially easy to mess with the system).

For me that's a showstopper at the moment, until they integrate uid namespaces.

However, I've recently come across a different container system "vagga" [1,2] which I think it's much more suited to be used with HTCondor (in fact, it doesn't require any modification in HTCondor's code, since all the jobs are run as the user). I know it's not as mature, and it's lacking certain features (namely, no network isolation, and only one predefined mountpoint within the container: the current working folder).

However I think that the network issue is not so important for the usual HTCondor job (where most users just want a controlled / special running environment, libraries and such), and the mountpoints can anyway be managed in some other way.

For me, the main two points for this system are:

* The lifecycle of the container is that of the command. So, you just "vagga foo", and the container is created and destroyed along with the process, so you needn't do any container managment.
* I've already said it, haven't I? No root involvement at all, everything is run as the user, and permissions / acls / cgroups are fully enforced.

Best,

Joan

[1]: http://vagga.readthedocs.org/en/latest/
[2]: https://github.com/tailhook/vagga

El 06/12/14 a las 02:03, Todd Tannenbaum escribió:
On 12/5/2014 6:27 PM, Luke Winslow wrote:
Hi All,

Quick question. Has anyone experimented with using Docker as a job
container internal to Condor? We are experimenting with it to improve
how we manage the job environment for Condor jobs. Just curious if
anyone was doing anything already. General searches (as well as here)
didn't point me to any examples.

Thanks!

-Luke


Here at the UW CHTC, some HTCondor developers have also done a bunch of experimenting w/ Docker, had discussions with Docker folks at OSCON 2014 re Docker+HTCondor, etc. Be aware that we are planning to add first-class support for HTCondor management of Docker containers as jobs in the first quarter of 2015.  I.e. a "universe = docker" option in the submit file.  The ticket for this is at
  https://htcondor-wiki.cs.wisc.edu/index.cgi/tktview?tn=4497
which at this point just includes a link to a design document that gives a high-level description of what we plan to do for the first pass.  Feel free to read the design doc (it is only a couple pages) and please leave remarks in the ticket with feedback/thoughts/findings!  To leave remarks in the ticket, you'll need a login on the htcondor-wiki which you can obtain by dropping an email to htcondor-admin@xxxxxxxxxxx.

regards,
Todd
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/