Re: [HTCondor-users] HTCondor with Fscache

[Thomas Hartmann <thomas.hartmann@xxxxxxx>]

Hi Gagan,

you will need to know the file access in advance for the job brokering 
for such a case.
Condor as such does not know, what files are read/write by the jobs, so 
that the information is not readily available - especially with a 
limited transient cache.

Maybe you could write a file transfer plugin, that does not actually 
transefrs files but just acts as intermediary, so that a job could 
announce the files it is going to read through such a hypothetical plug 
in. But then you would need no incorporate the information into the 
matchmaking (and all the jobs would need to know/announce their file 
inventory)

Cheers,
  Thomas

On  2025-11-21 05:02, gagan tiwari wrote:
> Hi Guys,
>  Â Â Â Â Â Â Â Â Â Â ÂAnyone has any ideas / adviceÂon this?ÂPlz letÂme know
> Thanks,
> Gagan
>
> On Wed, Nov 19, 2025 at 8:28âPM gagan tiwari <gagan.tiwari@mathisys- 
> india.com <mailto:gagan.tiwari@xxxxxxxxxxxxxxxxxx>> wrote:
>
>     Hi Guys,
>      Â Â Â Â Â Â Â Â Â We use FScache on all worker nodes to makeÂjobs
>     run faster. But sometimes jobs get assigned to worker nodes that
>     don't have jobs data in cache and it triggers fetchingÂof files over
>     the network and that causesÂdelay.
>
>     Please let me know how I can configureÂHTCondor to make it
>     assignÂjobs on the worker nodes which have data of jobs in the
>     fscache disk.
>
>     Thanks,
>     Gagan
>
>
>
>
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
>
> The archives can be found at: https://www-auth.cs.wisc.edu/lists/htcondor-users/

Attachment: smime.p7s
Description: S/MIME Cryptographic Signature