Re: [HTCondor-users] lvm metadata archiving

[Cole Bollig <cabollig@xxxxxxxx>]

Hi Michael,

If you turn on D_FULLDEBUG for the StartD and Starter you will see all of the commands with arguments that the HTCondor daemons (StartD and Starter) are running to manage LVM. You might be able to connect a command execution with a new archival file.

-Cole Bollig

---

From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Michael Thomas <wart@xxxxxxxxxxx>
Sent: Friday, February 21, 2025 3:49 PM
To: htcondor-users@xxxxxxxxxxx <htcondor-users@xxxxxxxxxxx>
Subject: Re: [HTCondor-users] lvm metadata archiving

 

Hi Cole,

I guess I'm not seeing the desired behavior then, because
/etc/lvm/archive is still getting populated with new archive entries for
condor:

[root@node36 ~]# ls -l /etc/lvm/archive
total 60
-rw-------. 1 root root 1009 Feb 21 13:34 condor_00000-1638320359.vg
-rw-------. 1 root root 1009 Feb 21 13:34 condor_00001-460257242.vg
-rw-------. 1 root root  947 Feb 21 13:46 condor_00002-2021812796.vg
-rw-------. 1 root root 1889 Feb 21 13:46 condor_00003-698536540.vg
-rw-------. 1 root root 1864 Feb 21 14:08 condor_00004-1090285748.vg
-rw-------. 1 root root 2327 Feb 21 14:08 condor_00005-22124147.vg
-rw-------. 1 root root 2355 Feb 21 14:08 condor_00006-60270403.vg
-rw-------. 1 root root 2779 Feb 21 14:09 condor_00007-970492402.vg
-rw-------. 1 root root 2355 Feb 21 14:11 condor_00008-3312197.vg
-rw-------. 1 root root 2769 Feb 21 14:12 condor_00009-37119960.vg
-rw-------. 1 root root 2352 Feb 21 14:46 condor_00010-1036201810.vg
-rw-------. 1 root root 2354 Feb 21 14:46 condor_00011-1532942938.vg
-rw-------. 1 root root 2354 Feb 21 15:46 condor_00012-266977466.vg
-rw-------. 1 root root 2354 Feb 21 15:46 condor_00013-2078303505.vg
-rw-------. 1 root root 1750 Aug 22  2022 node36.1_00000-272466926.vg

[root@node36 ~]# rpm -q condor
condor-24.4.0-1.el8.x86_64

Is there a logging knob I can turn to help figure out why these are
still showing up?

--Mike

On 2/21/25 15:44, Cole Bollig via HTCondor-users wrote:
> Hi Michael,
>
> There is no configuration that needs to be added to enable the use of --autobackup n as this is hard coded into a lot of the commands HTCondor uses to manage the ephemeral LVs. One thing to note is that the archiving still occurs when an administrator comes through and manually runs specific LVM commands. HTCondor can only help reduce overloading the host with archives due to it's rapid LV creation/deletion.
>
> Perhaps I should implement a Startd Cron to periodically remove all but the last N most recent volume group archives (of the VG associated with/used by HTCondor).
>
> Cheers,
> Cole Bollig
> ________________________________
> From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Michael Thomas <wart@xxxxxxxxxxx>
> Sent: Friday, February 21, 2025 2:15 PM
> To: condor-users@xxxxxxxxxxx <condor-users@xxxxxxxxxxx>
> Subject: [HTCondor-users] lvm metadata archiving
>
> The release notes for htcondor-24.4.0 reference a fix for HTCONDOR-2791:
>
> "HTCondor should use the -A/--autobackup n option to prevent a new
> backup being created and archived since HTCondor does lots of lvcreate
> and lvremove."
>
> But in my recently upgraded 24.4.0 cluster, this doesn't seem to be
> having any effect.  New lvm archives are still being logged to
> /etc/lvm/archive/
>
> Is there some htcondor config setting I need to apply to disable this
> metadata archiving, or is it supposed to be the default behavior?
>
> --Mike
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
>
> Join us in June at Throughput Computing 25: https://urldefense.com/v3/__https://osg-htc.org/htc25__;!!Mak6IKo!J_HhNfdQ9ppZnUDArFcLbPTHaWTn0we3iwUZQ1WtlMZf6r4tj96YaKfgzmoP0nx7n78qRJwyEIxBNcLV$
>
> The archives can be found at: https://www-auth.cs.wisc.edu/lists/htcondor-users/
>
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
>
> Join us in June at Throughput Computing 25: https://urldefense.com/v3/__https://osg-htc.org/htc25__;!!Mak6IKo!Oc9rCJnXo34-3vEwHmGTgR-pjQiEW1xhcjYAbFW5Z_qEjpsgm51HA46RTSVEBJMsPx0cBq5TIHw4JOZw$
>
> The archives can be found at: https://www-auth.cs.wisc.edu/lists/htcondor-users/

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe

Join us in June at Throughput Computing 25: https://urldefense.com/v3/__https://osg-htc.org/htc25__;!!Mak6IKo!Oc9rCJnXo34-3vEwHmGTgR-pjQiEW1xhcjYAbFW5Z_qEjpsgm51HA46RTSVEBJMsPx0cBq5TIHw4JOZw$

The archives can be found at: https://www-auth.cs.wisc.edu/lists/htcondor-users/