[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Migrating to htcondor2 -> pypi LTS supported version?



Hi All,

> Due to limited space on PyPI, we have to remove older versions to make room for new versions.

> Do you think it would be feasible to keep the latest patch release available in PyPi for a certain period of time (maybe for 3-4 years)? Or do you think that the python bindings will hardly be compatible with HTCondor daemons running in newer versions?

Maybe I'm missing the obvious, but if you need indefinite long-term support of Python packages why don't you use the conda-forge distributions https://github.com/conda-forge/htcondor-feedstock?  (Also props to Duncan, that feedstock looks very well maintained.) Conda-forge is immutable and so those distributions will be up and usable for as long as conda-forge is (and it isn't very hard to create a mirror of (some or all of) conda-forge if you want to have your own long term sustainability backup plan).

Best,
Matthew

-- Matthew Feickert University of Wisconsin-Madison


From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of htcondor-users-request@xxxxxxxxxxx <htcondor-users-request@xxxxxxxxxxx>
Sent: Tuesday, September 9, 2025 19:00
To: htcondor-users@xxxxxxxxxxx <htcondor-users@xxxxxxxxxxx>
Subject: HTCondor-users Digest, Vol 142, Issue 9
 
Send HTCondor-users mailing list submissions to
        htcondor-users@xxxxxxxxxxx

To subscribe or unsubscribe via the World Wide Web, visit
        https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
or, via email, send a message with subject or body 'help' to
        htcondor-users-request@xxxxxxxxxxx

You can reach the person managing the list at
        htcondor-users-owner@xxxxxxxxxxx

When replying, please edit your Subject line so it is more specific
than "Re: Contents of HTCondor-users digest..."


Today's Topics:

   1. Re: Migrating to htcondor2 -> pypi LTS supported version?
      (Tim Theisen)


----------------------------------------------------------------------

Message: 1
Date: Tue, 9 Sep 2025 10:36:51 -0500
From: Tim Theisen <tim@xxxxxxxxxxx>
To: Alan Malta Rodrigues <amaltar2@xxxxxx>,     Kenyi Hurtado Anampa
        <khurtado@xxxxxx>
Cc: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Subject: Re: [HTCondor-users] Migrating to htcondor2 -> pypi LTS
        supported version?
Message-ID: <7be29453-7474-402c-9c37-d083b77703a6@xxxxxxxxxxx>
Content-Type: text/plain; charset="utf-8"; Format="flowed"

We already keep the latest patch release for each LTS series for as long
as possible. In PyPI right now:

23.0.28? Aug 21, 2025
10.0.9??? Sep 28, 2023
9.0.17??? Sep 29, 2022
8.8.15??? Aug ? 3, 2021

The last patch for HTCondor 24.0 will appear sometime next year and that
will be retained indefinitely.

So, yes, any 24.0.x fits the definition of a compatible release.

...Tim

On 9/9/25 07:25, Alan Malta Rodrigues wrote:
> Hi Tim,
>
> Do you think it would be feasible to keep the latest patch release
> available in PyPi for a certain period of time (maybe for 3-4 years)?
> Or do you think that the python bindings will hardly be compatible
> with HTCondor daemons running in newer versions?
>
> My understanding from the compatible release operator [1] is that, as
> long as there is a 24.0.x release in PyPi, we would be able to satisfy
> the htcondor version when building our application.
>
> Best regards,
> Alan.
>
> [1]
> https://urldefense.com/v3/__https://peps.python.org/pep-0440/*compatible-release__;Iw!!Mak6IKo!Mrdf1RSwM4EwZS6t2IpCGKDLULl2U4R2kSweGiVIFsKOIcfQlBaUfciSI0qam60ugmhvSfXBwo79G-L-Mo-pbu2bqkGxZ1yUmOX_rKY$ 
> <https://urldefense.com/v3/__https://peps.python.org/pep-0440/*compatible-release__;Iw!!Mak6IKo!KZ8DyhDd4_PfS1x50QT5kOq3gQLWrXReXlR4AKQXEKId0FZH8UhvLHiur0Dp9XmUwukCoO21uDKv7l2c$>
>
>
> On Mon, Sep 8, 2025 at 8:37?PM Kenyi Hurtado Anampa <khurtado@xxxxxx>
> wrote:
>
>     Thank you for your responses.
>
>     We specify a single version, because we usually perform validation
>     tests before moving to a different version. We are currently using
>     24.0.10.
>
>     https://urldefense.com/v3/__https://github.com/dmwm/WMCore/blob/master/requirements.txt*L25__;Iw!!Mak6IKo!Mrdf1RSwM4EwZS6t2IpCGKDLULl2U4R2kSweGiVIFsKOIcfQlBaUfciSI0qam60ugmhvSfXBwo79G-L-Mo-pbu2bqkGxZ1yUlR6lNjk$
>     <https://urldefense.com/v3/__https://github.com/dmwm/WMCore/blob/master/requirements.txt*L25__;Iw!!Mak6IKo!KZ8DyhDd4_PfS1x50QT5kOq3gQLWrXReXlR4AKQXEKId0FZH8UhvLHiur0Dp9XmUwukCoO21uBUYtnQh$>
>
>     Best regards,
>     Kenyi
>
>     On Mon, Sep 8, 2025 at 2:14?PM Tim Theisen <tim@xxxxxxxxxxx> wrote:
>
>         I don't have a really good answer for you. Due to limited
>         space on PyPI,
>         we have to remove older versions to make room for new versions.
>
>         However, our LTS version interface remains stable during the
>         lifetime of
>         the series. The only thing that would have a stable version
>         number for
>         the 24.0.x series, would be to have a 24.0 version and used
>         -post1
>         -post2 suffixes.
>
>         Could you specify a range in your requirement?
>         htcondor>=24.0.0,<=24.0.999
>
>         ...Tim
>
>         On 9/2/25 10:21, Kenyi Hurtado Anampa via HTCondor-users wrote:
>         > Hello,
>         >
>         > In CMS, we are planning to freeze the current production WM
>         system and
>         > we are looking to migrate from htcondor to htcondor2 python
>         bindings
>         > before that.
>         >
>         > Our schedds currently have HTCondor 24.0.6, and we submit
>         via python,
>         > using the htcondor python bindings from pypi.
>         >
>         > Is there a particular version from pypi that is recommended
>         for this
>         > case? We would like to make sure we pick a version that
>         stays?long
>         > term in pypi. We had seen at least one version disappearing
>         from pypi
>         > in the past, so we just want to double check before e.g.
>         just choosing
>         > the latest one available.
>         >
>         > Best regards,
>         > Kenyi
>         >
>         > _______________________________________________
>         > HTCondor-users mailing list
>         > To unsubscribe, send a message to
>         htcondor-users-request@xxxxxxxxxxx with a
>         > subject: Unsubscribe
>         >
>         > The archives can be found at:
>         https://www-auth.cs.wisc.edu/lists/htcondor-users/
>
>         --
>         Tim Theisen (he, him, his)
>         Release Manager
>         Center for High Throughput Computing
>         Department of Computer Sciences
>         University of Wisconsin - Madison
>         4261 Computer Sciences and Statistics
>         1210 W Dayton St
>         Madison, WI 53706-1685
>         +1 608 265 5736
>
--
Tim Theisen (he, him, his)
Release Manager
Center for High Throughput Computing
Department of Computer Sciences
University of Wisconsin - Madison
4261 Computer Sciences and Statistics
1210 W Dayton St
Madison, WI 53706-1685
+1 608 265 5736
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www-auth.cs.wisc.edu/lists/htcondor-users/attachments/20250909/8d0461ff/attachment.html >

------------------------------

Subject: Digest Footer

_______________________________________________
HTCondor-users mailing list
HTCondor-users@xxxxxxxxxxx

Join us in June at Throughput Computing 25: https://urldefense.com/v3/__https://osg-htc.org/htc25__;!!Mak6IKo!Mrdf1RSwM4EwZS6t2IpCGKDLULl2U4R2kSweGiVIFsKOIcfQlBaUfciSI0qam60ugmhvSfXBwo79G-L-Mo-pbu2bqkGxZ1yUoWV-Cv0$

The archives can be found at: https://www-auth.cs.wisc.edu/lists/htcondor-users/


------------------------------

End of HTCondor-users Digest, Vol 142, Issue 9
**********************************************