[HTCondor-users] zswap for jobs

[Emily Kooistra <a66@xxxxxxxxx>]

Hi,

Does anyone have operational experience with running zswap on EPs?

I was wondering what the compression rates people are getting for this?

Right now there is no native support for limiting the amount of this in 
the cgroups (via htcondor) 
(https://www.kernel.org/doc/html/latest/admin-guide/mm/zswap.html), but 
even without this i would assume that it can give some nice gains with 
overprovisioning memory to some regard.

Specifically given, with the "default" cgroup hard limits, we have right 
now quite a lot of "spare" ram that could be used for disk caches or 
other reasons, but increasing the limits too much is also no ideal, so 
exploring possibilities on how to make more efficent use of the 
resources wile also preventing running out of memory if memory intensive 
resources are running.

Emily Kooistra
NIKHEF