[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] lvm metadata archiving



Hi Cole,

I guess I'm not seeing the desired behavior then, because /etc/lvm/archive is still getting populated with new archive entries for condor:

[root@node36 ~]# ls -l /etc/lvm/archive
total 60
-rw-------. 1 root root 1009 Feb 21 13:34 condor_00000-1638320359.vg
-rw-------. 1 root root 1009 Feb 21 13:34 condor_00001-460257242.vg
-rw-------. 1 root root  947 Feb 21 13:46 condor_00002-2021812796.vg
-rw-------. 1 root root 1889 Feb 21 13:46 condor_00003-698536540.vg
-rw-------. 1 root root 1864 Feb 21 14:08 condor_00004-1090285748.vg
-rw-------. 1 root root 2327 Feb 21 14:08 condor_00005-22124147.vg
-rw-------. 1 root root 2355 Feb 21 14:08 condor_00006-60270403.vg
-rw-------. 1 root root 2779 Feb 21 14:09 condor_00007-970492402.vg
-rw-------. 1 root root 2355 Feb 21 14:11 condor_00008-3312197.vg
-rw-------. 1 root root 2769 Feb 21 14:12 condor_00009-37119960.vg
-rw-------. 1 root root 2352 Feb 21 14:46 condor_00010-1036201810.vg
-rw-------. 1 root root 2354 Feb 21 14:46 condor_00011-1532942938.vg
-rw-------. 1 root root 2354 Feb 21 15:46 condor_00012-266977466.vg
-rw-------. 1 root root 2354 Feb 21 15:46 condor_00013-2078303505.vg
-rw-------. 1 root root 1750 Aug 22  2022 node36.1_00000-272466926.vg

[root@node36 ~]# rpm -q condor
condor-24.4.0-1.el8.x86_64

Is there a logging knob I can turn to help figure out why these are still showing up?

--Mike

On 2/21/25 15:44, Cole Bollig via HTCondor-users wrote:
Hi Michael,

There is no configuration that needs to be added to enable the use of --autobackup n as this is hard coded into a lot of the commands HTCondor uses to manage the ephemeral LVs. One thing to note is that the archiving still occurs when an administrator comes through and manually runs specific LVM commands. HTCondor can only help reduce overloading the host with archives due to it's rapid LV creation/deletion.

Perhaps I should implement a Startd Cron to periodically remove all but the last N most recent volume group archives (of the VG associated with/used by HTCondor).

Cheers,
Cole Bollig
________________________________
From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Michael Thomas <wart@xxxxxxxxxxx>
Sent: Friday, February 21, 2025 2:15 PM
To: condor-users@xxxxxxxxxxx <condor-users@xxxxxxxxxxx>
Subject: [HTCondor-users] lvm metadata archiving

The release notes for htcondor-24.4.0 reference a fix for HTCONDOR-2791:

"HTCondor should use the -A/--autobackup n option to prevent a new
backup being created and archived since HTCondor does lots of lvcreate
and lvremove."

But in my recently upgraded 24.4.0 cluster, this doesn't seem to be
having any effect.  New lvm archives are still being logged to
/etc/lvm/archive/

Is there some htcondor config setting I need to apply to disable this
metadata archiving, or is it supposed to be the default behavior?

--Mike
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe

Join us in June at Throughput Computing 25: https://urldefense.com/v3/__https://osg-htc.org/htc25__;!!Mak6IKo!J_HhNfdQ9ppZnUDArFcLbPTHaWTn0we3iwUZQ1WtlMZf6r4tj96YaKfgzmoP0nx7n78qRJwyEIxBNcLV$

The archives can be found at: https://www-auth.cs.wisc.edu/lists/htcondor-users/


_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe

Join us in June at Throughput Computing 25: https://osg-htc.org/htc25

The archives can be found at: https://www-auth.cs.wisc.edu/lists/htcondor-users/