Re: [Condor-users] Output files not returned on vanilla pool

[Matthew Farrellee <matt@xxxxxxxxxx>]

FYI, at submit time use $(Cluster) not $(ClusterID)

http://www.cs.wisc.edu/condor/manual/v7.4/2_5Submitting_Job.html#3748

Best,


matt

On 01/28/2010 09:10 PM, Ralph & Maria Finch wrote:
> Well, I found the problem, but a good solution eludes me.  I have
> implemented a poor solution:
> 
>  
> 
> The .sub file below is created in a Windows command FOR loop over
> potentially thousands of variant inputs to a program, each of which must
> be stored in a different named output file for later processing.  So the
> .sub file is created on the fly, a condor_submit issued, and around the
> loop goes.  I had no delay in the loop and by the time the first
> condor_submit was executed a number of cycles had occurred, overwriting
> previous .sub files and confusing everything.
> 
>  
> 
> I put a delay in the loop and all is well.  But it’s a kluge.  I could
> also have different name for each .sub file and submit that, but the
> directory will fill with hundreds or thousands of these.  Instead, I’d
> like a wait to delay the loop by the condor_submit command itself; when
> the command executes, the loop goes through one more cycle.  Possible?
> 
>  
> 
> And another question I have is, the $(ClusterID) macro isn’t working. 
> Am I using it correctly?
> 
>  
> 
> Ralph Finch
> 
> California Dept. of Water Resources
> 
>  
> 
> *From:* Ralph&Maria Finch [mailto:ralphmariafinch@xxxxxxxxx]
> *Sent:* Wednesday, January 27, 2010 11:31 AM
> *To:* Condor-Users Mail List
> *Subject:* Output files not returned on vanilla pool
> 
>  
> 
> $CondorVersion: 7.2.4 Jun 15 2009 BuildID: 159529 $
> $CondorPlatform: INTEL-WINNT50 $
> 
> the .sub file:
> =========
> 
> universe = vanilla
> getenv = true
> SHOULD_TRANSFER_FILES  =  ALWAYS
> WHEN_TO_TRANSFER_OUTPUT  =  ON_EXIT_OR_EVICT
> Rank = kflops
> #Requirements = (Machine != "DELTA-MOD.ad.water.ca.gov
> <http://DELTA-MOD.ad.water.ca.gov>")
> executable = condor_dsm2.bat
> error = dsm2$(ClusterID).err
> log = dsm2$(ClusterID).log
> output = dsm2$(ClusterID).out
> transfer_input_files = d:\delta\dsm2_v8\bin\hydro.exe,
> d:\delta\dsm2_v8\bin\qual.exe, config.inp, hydro.inp, qual_ec.inp <snip>
> 
> transfer_output_files = HIST-CLB2K-ManN_Ch009.dss
> 
> queue
> 
>  
> 
> __________ Information from ESET Smart Security, version of virus
> signature database 4811 (20100127) __________
> 
>  
> 
> The message was checked by ESET Smart Security.
> 
>  
> 
> http://www.eset.com
> 
> 
> 
> __________ Information from ESET Smart Security, version of virus
> signature database 4816 (20100128) __________
> 
> The message was checked by ESET Smart Security.
> 
> http://www.eset.com
> 
> 
> 
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
> 
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/condor-users/