[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Why are python bindings pulled so quickly?



On 12/16/2025 12:55 PM, Jordan Corbett-Frank via HTCondor-users wrote:
Hi all, 

We're on the 24 LTS release and were briefly blocked  because condor 24.0.13 was pulled from py-pi. We quickly upgraded  to 24.0.15, but this happens periodically, so I'd like to understand why they are pulled so quickly. 

Thanks!
Jordan 

Hi Jordan,

The reason is because PyPI gives very limited storage space to projects for packages.  You cannot even purchase more space, you can only request it.  We requested more space for HTCSS back in Sept 2025, and PyPI refused to increase our disk quota.  We made a second plea yesterday, we will see if they have changed their mind.  We have a plan to somewhat reduce the amount of disk space we need on PyPI; we will try to implement those changes in the weeks to come.  Another idea is we could have PyPI host the recent packages like it does now, and then add a package index at htcondor.org that holds a much larger archive (you would then add "--extra-index-url xxxx" line to your requirements.txt file).  Curious how folks feel about a python package archive archive at htcondor.org outside of PyPI.

Meanwhile, I see you are using the LTS version of HTCSS 24 (v24.0.x).  Since we ensure that all patch releases in an LTS series are backwards and forwards compatible with each other, I suggest you change your PyPI requirements from

  htcondor==24.0.13

to instead be 

  htcondor~=24.0.0

The "~=" is the "compatible release operator" and I think this what you want to use.

regards,
Todd

-- 
Todd Tannenbaum <tannenba@xxxxxxxxxxx>  University of Wisconsin-Madison
Center for High Throughput Computing    Department of Computer Sciences