Re: [Condor-users] Problem with multiple machines in a Windows pool

Mailing List Archives Authenticated access	UW Madison Computer Sciences Department Computer Systems Lab

On Mon, Aug 22, 2011 at 2:56 PM, John (TJ) Knoeller <johnkn@xxxxxxxxxxx> wrote:

It looks like an access rights problem. the Condor daemons run as SYSTEM so if any of the files or sub-directories of the execute directory
deny delete access to SYSTEM, condor might be unable to cleanup after your job, this message seems to indicate that that is the case.

ERROR: C:\Condor\execute\dir_3180 still exists after trying to add Full control to ACLs for PRIV_ROOT

There is code in the starter to try and change the ACLs on files in the execute directory after the jobs exits, but that code doesn't work
if the total pathname length of any file exceeds 260 characters.

There is a special program called condor_rmdir that ships with condor (in the bin directory) that can handle deleting long paths
with SYSTEM deny ACLs, but I suspect that that program is not enabled in your condor_config file.

search for WINDOWS_RMDIR in your config file. you should see something like this...

# On Windows, the built-in rmdir command will not delete directories # or files that have Discretionary Access Control (DACLs) that deny # access to the SYSTEM account. This binary will take ownership of # files and directories and remove DACLs if needed to delete a # directory. Elevated priveleges are needed for it to operate so # set this only if Condor runs as SYSTEM. (i.e. as a service) #WINDOWS_RMDIR = $(SBIN)\condor_rmdir.exe #WINDOWS_RMDIR_OPTIONS = /s /c
try un-commenting the last two lines.

-tj

On 8/22/2011 2:34 PM, Ralph Finch wrote:
The offending machine below still has the same problems even after getting the CREDD stuff to work in the pool (on the master and all machines). But now other machines share one problem: they will not delete the running directory. They do run the model, unlike the machine below, but won't delete the execute directory. Thus the c:\ drive gradually gets full and at some point will quit accepting jobs.

These problem machines are all Win7x64. Our other Windows computers are XPx86 and don't have the no-delete-directory problem. We have no Linux computers in the pool.

It must be some kind of privilege problem but at this point I don't know where to look further. Even my machine which I submit from has the problem. From Windows Explorer I've made sure that users within our Group (DELTA) have full control of the c:\condor directory, and it is shared fully to that Group.

Ralph Finch
Calif. Dept. of Water Resources
Sacramento, California, USA

On Sat, Aug 20, 2011 at 5:30 PM, Ralph Finch <ralphmariafinch@xxxxxxxxx> wrote:

We have a pool of about 20 Windows machines, XP or Win7x64, Condor 7.6.1. One machine acts badly and I can't figure out why.

The offending machine is a Win7x64. The problem is, it accepts jobs, but immediately kills them. Also, it can't get permissions to delete the now-unneeded execute\dir_**** directories, so those accumulate. Eventually the c: drive free space decreases to below the submitted jobs' limits, and the machine quits accepting new jobs.

The model error and output log files on the problem machine are empty...I don't think the model even started. If the problem was only directory permissions, how can the input files be written to the execute directory, and and log files created, though empty? Instead it seems like an execute permission problem.

Several other machines are set up "identically", that is, as much as we know they're identical, though clearly something is wrong on that one machine. I've reproduced some log files below...but I'm hoping someone had a similar problem and can point us to the fix we need to make.

StarterLog.slot1 (notice the immediate job end and error deleting the old execute dir):

08/20/11 16:05:29 Setting maximum accepts per cycle 4.
08/20/11 16:05:29 ******************************************************
08/20/11 16:05:29 ** condor_starter (CONDOR_STARTER) STARTING UP
08/20/11 16:05:29 ** C:\Condor\bin\condor_starter.exe
08/20/11 16:05:29 ** SubsystemInfo: name=STARTER type=STARTER(8) class=DAEMON(1)
08/20/11 16:05:29 ** Configuration: subsystem:STARTER local:<NONE> class:DAEMON
08/20/11 16:05:29 ** $CondorVersion: 7.6.1 May 31 2011 BuildID: 339001 $
08/20/11 16:05:29 ** $CondorPlatform: x86_winnt_5.1 $
08/20/11 16:05:29 ** PID = 3180
08/20/11 16:05:29 ** Log last touched 8/20 15:05:28
08/20/11 16:05:29 ******************************************************
08/20/11 16:05:29 Using config source: C:\condor\condor_config
08/20/11 16:05:29 Using local config sources:
08/20/11 16:05:29 C:/Condor/condor_config.local
08/20/11 16:05:29 DaemonCore: command socket at <136.200.32.170:63768>
08/20/11 16:05:29 DaemonCore: private command socket at <136.200.32.170:63768>
08/20/11 16:05:29 Setting maximum accepts per cycle 4.
08/20/11 16:05:29 GLEXEC_JOB not supported on this platform; ignoring
08/20/11 16:05:29 Setting resource limits not implemented!
08/20/11 16:05:29 Communicating with shadow <136.200.32.119:62991>
08/20/11 16:05:29 Submitting machine is "bdomo-002.ad.water.ca.gov"
08/20/11 16:05:29 setting the orig job name in starter
08/20/11 16:05:29 setting the orig job iwd in starter
08/20/11 16:05:46 File transfer completed successfully.
08/20/11 16:05:47 Job 1933.0 set to execute immediately
08/20/11 16:05:47 Starting a VANILLA universe job with ID: 1933.0
08/20/11 16:05:47 Tracking process family by login "condor-reuse-slot1"
08/20/11 16:05:47 IWD: C:\Condor\execute\dir_3180
08/20/11 16:05:47 Output file: C:\Condor\execute\dir_3180\dsm2-085.out
08/20/11 16:05:47 Error file: C:\Condor\execute\dir_3180\dsm2-085.err
08/20/11 16:05:47 Renice expr "10" evaluated to 10
08/20/11 16:05:47 About to exec C:\Condor\execute\dir_3180\condor_exec.bat hydro085.inp, qual_ec085.inp
08/20/11 16:05:47 Executable is a batch file, running: "C:\Windows\system32\cmd.exe" /Q /C "C:\Condor\execute\dir_3180\condor_exec.bat" hydro085.inp, qual_ec085.inp
08/20/11 16:05:47 Create_Process succeeded, pid=6184
08/20/11 16:05:47 Process exited, pid=6184, status=-1073741701
08/20/11 16:05:47 Got SIGQUIT. Performing fast shutdown.
08/20/11 16:05:47 ShutdownFast all jobs.
08/20/11 16:05:48 ERROR: C:\Condor\execute\dir_3180 still exists after trying to add Full control to ACLs for PRIV_ROOT
08/20/11 16:05:48 **** condor_starter (condor_STARTER) pid 3180 EXITING WITH STATUS 0

.machine.ad
ClockMin = 587
IsWakeAble = true
slot4_EnteredCurrentActivity = 1313858781
Activity = "Idle"
ClockDay = 6
Cpus = 1
EnteredCurrentState = 1313858781
HibernationLevel = 0
IsOwner = ( START =?= false )
KFlops = 1180110
NextFetchWorkDelay = -1
HibernationState = "NONE"
MyType = "Machine"
slot4_KeyboardIdle = 344908
TotalTimeClaimedIdle = 606
WindowsBuildNumber = 7600
MonitorSelfTime = 1313858814
slot1_KeyboardIdle = 41949
SubnetMask = "255.255.255.0"
WANT_VACATE = false
CondorPlatform = "$CondorPlatform: x86_winnt_5.1 $"
slot2_EnteredCurrentActivity = 1313858795
slot4_Activity = "Idle"
WindowsProductType = 1
LastBenchmark = 1313857754
LastUpdate = 1313857754
TotalCondorLoadAvg = 0.040000
TotalTimeUnclaimedIdle = 332499
KILL = false
WakeOnLanEnabledFlags = "Magic Packet"
CheckpointPlatform = "WINNT61 X86_64 Unknown normal"
Memory = 3067
slot3_State = "Claimed"
State = "Claimed"
TotalSlots = 4
CpuBusyTime = 0
SlotWeight = Cpus
CondorLoadAvg = 0.0
CurrentRank = 0.0
MonitorSelfResidentSetSize = 16444
RemoteOwner = "rfinch@xxxxxxxxxxxx"
TotalDisk = 4419932
TotalTimePreemptingVacating = 3
WakeOnLanSupportedFlags = "Magic Packet"
ClientMachine = "bdomo-002.ad.water.ca.gov"
MyAddress = "<136.200.32.170:64632>"
NumPids = 0
HasReconnect = true
HasIOProxy = true
HasPerFileEncryption = true
START = ( SlotID <= 2 && ( ( ( KeyboardIdle < 5 * 60 ) || ( ConsoleIdle < 5 * 60 ) ) == false ) && ( Disk > 500000 ) && ( ( ( LoadAvg - CondorLoadAvg ) <= 0.300000 ) || ( State != "Unclaimed" && State != "Owner" ) ) ) || ( SlotID > 2 && ( Disk > 500000 ) && ( ( ( LoadAvg - CondorLoadAvg ) <= 0.300000 ) || ( State != "Unclaimed" && State != "Owner" ) ) )
StartdIpAddr = "<136.200.32.170:64632>"
UidDomain = "water.ca.gov"
CpuBusy = ( ( LoadAvg - CondorLoadAvg ) >= 0.800000 )
CpuIsBusy = false
KeyboardIdle = 344908
LastFetchWorkSpawned = 0
RemoteUser = "rfinch@xxxxxxxxxxxx"
slot3_KeyboardIdle = 344908
TotalCpus = 4
CLAIM_WORKLIFE = 120
TotalTimeOwnerIdle = 10446
FileSystemDomain = "water.ca.gov"
HibernationSupportedStates = "S3,S4,S5"
Machine = "bdomo-003.ad.water.ca.gov"
ImageSize = 1
IsWakeOnLanSupported = true
PublicClaimId = "<136.200.32.170:64632>#1313515118#82#..."
slot4_State = "Claimed"
CondorVersion = "$CondorVersion: 7.6.1 May 31 2011 BuildID: 339001 $"
EnteredCurrentActivity = 1313858781
HasJICLocalConfig = true
HasWindowsRunAsOwner = true
MonitorSelfAge = 343695
slot3_EnteredCurrentActivity = 1313858821
SlotID = 4
HardwareAddress = "00:10:18:61:3B:8B"
MonitorSelfImageSize = 141716.000000
MyCurrentTime = 1313858732
Rank = ( 10000 * ( Owner == "none" ) )
Requirements = ( START ) && ( IsValidCheckpointPlatform )
TotalVirtualMemory = 4194303
WANT_HOLD = false
MonitorSelfSecuritySessions = 21
Name = "slot4@xxxxxxxxxxxxxxxxxxxxxxxxx"
TargetType = "Job"
TotalMemory = 12271
Unhibernate = MY.MachineLastMatchTime =!= undefined
Arch = "X86_64"
TimeToLive = 2147483647
TotalLoadAvg = 0.700000
WindowsMinorVersion = 1
WindowsServicePackMinorVersion = 0
HasJICLocalStdin = true
MaxJobRetirementTime = 0
MonitorSelfCPUUsage = 0.331284
slot1_Activity = "Busy"
slot1_State = "Claimed"
CanHibernate = true
HasJobDeferral = true
HasTDP = true
slot1_LoadAvg = 0.020000
VirtualMemory = 1048575
CONTINUE = ( ( TotalJobSuspendTime =!= undefined ) && ( TotalJobSuspendTime > 2 * ( 60 * 60 ) ) ) || ( SlotID <= 2 && ( ( ( KeyboardIdle < 5 * 60 ) || ( ConsoleIdle < 5 * 60 ) ) == false ) ) || ( SlotID > 2 && ( LoadAvg - CondorLoadAvg ) <= 0.300000 )
ExecutableSize = 1
IsValidCheckpointPlatform = ( ( ( TARGET.JobUniverse == 1 ) == false ) || ( ( MY.CheckpointPlatform =!= undefined ) && ( ( TARGET.LastCheckpointPlatform =?= MY.CheckpointPlatform ) || ( TARGET.NumCkpts == 0 ) ) ) )
PREEMPT = false
slot1_EnteredCurrentActivity = 1313858817
slot2_LoadAvg = 0.660000
TotalTimeClaimedBusy = 152
COLLECTOR_HOST_STRING = "delta-mod.water.ca.gov"
LoadAvg = 0.0
OpSys = "WINNT61"
slot2_KeyboardIdle = 41949
slot3_LoadAvg = 0.020000
WindowsMajorVersion = 6
WindowsServicePackMajorVersion = 0
HasVM = false
IsWakeOnLanEnabled = true
slot4_LoadAvg = 0.0
StarterAbilityList = "HasJobDeferral,HasTDP,HasFileTransfer,HasJICLocalConfig,HasVM,HasWindowsRunAsOwner,HasReconnect,HasMPI,HasPerFileEncryption,HasJICLocalStdin"
slot2_Activity = "Idle"
ConsoleIdle = 344908
Mips = 6955
HasMPI = true
LastFetchWorkCompleted = 0
MonitorSelfRegisteredSocketCount = 4
SUSPEND = ( ( TotalJobSuspendTime =!= undefined ) && ( TotalJobSuspendTime <= 2 * ( 60 * 60 ) ) || ( TotalJobSuspendTime =?= undefined ) ) && ( ( SlotID <= 2 && ( ( KeyboardIdle < 5 * 60 ) || ( ConsoleIdle < 5 * 60 ) ) ) || ( ( LoadAvg - CondorLoadAvg ) > 0.800000 ) )
Disk = 1104983
RunBenchmarks = ( LastBenchmark == 0 ) || ( ( time() - LastBenchmark ) >= ( 4 * ( 60 * 60 ) ) )
TotalTimeMatchedIdle = 1
WANT_SUSPEND = true
JobUniverse = 5
slot2_State = "Owner"
HasFileTransfer = true
slot3_Activity = "Busy"
CurrentTime = time()
NiceUser = false

.job.ad
CurrentHosts = 1
JobUniverse = 5
LeaveJobInQueue = false
OrigMaxHosts = 1
StreamOut = false
JobRunCount = 2
PeriodicRemove = false

TransferInput = "hydro.exe,qual.exe,HIST-CLB2K-BASE-1991-v81_0.qrf,HIST-CLB2K-BASE-1991-v81_0.hrf,config.inp,hydro029.inp,qual_ec029.inp,029,PerturbedInpManN_Ch029.inp,boundary_flow_calsim_delta_20090715.inp,boundary_flow_delta_historical_20090715.inp,source_flow_jones_hydro_20090806.inp,boundary_stage_adjust_astro_tide_20090715.inp,boundary_stage_delta_historical_20090715.inp,channel_historical_stability_revision_20090715.inp,channel_ic_std_delta_grid_20090715.inp,channel_planning_stability_revision_20090715.inp,channel_std_delta_grid_20090715.inp,channel_tapered_tracy_blvd_dredge_20090715.inp,gate_permanent_barriers_20090715.inp,gate_std_delta_grid_20090827.inp,gate_temp_barriers_20090715.inp,generate.py,group_rate_coeff_groups_20090715.inp,group_sourcetracking_20090715.inp,input_climate_delta_historical_climate_20090715.inp,input_gate_planning_ccfb_dcc_timing_20090715.inp,node_concentration_calsim_delta_ec_20090715.inp,node_concentration_delta_historical_do_20090715.inp,node_concentratio n_delta_historical_qual_20090715.inp,node_concentration_dicu_do_20090715.inp,node_concentration_dicu_ec_20090715.inp,node_concentration_jones_qual_20090715.inp,node_concentration_mtz_planning_ec_20090715.inp,oprule_ccc_dual_intake_20090715.inp,oprule_hist_temp_barriers_20090715.inp,oprule_historical_gate_20090715.inp,oprule_montezuma_planning_gate_20090715.inp,oprule_sdip_20090715.inp,oprule_temp_barriers_planning_20090715.inp,output_channel_std_hydro_boundary_20090715.inp,output_channel_std_hydro_calib.inp,output_channel_std_qual_calib.inp,output_gate_sdip_20090715.inp,output_gate_temporary_barriers_20090715.inp,output_reservoir_std_hydro_named_20090715.inp,output_reservoir_std_qual_named_20090715.inp,output_reservoir_source_track_ec_20090715.inp,rate_coefficient_delta_ncc_20090715.inp,reservoir_concentration_dicu_ec_20090715.inp,reservoir_ic_std_delta_grid_20090715.inp,reservoir_std_delta_grid_20090715.inp,scalar_hydro_std_20090715.inp,scalar_qual_do_parameters_20090715.inp ,scalar_qual_std_20090715.inp,source_flow_calsim_delta_20090715.inp,source_flow_delta_historical_20090715.inp,source_flow_dicu_20090715.inp,source_flow_dicu_historical_20090715.inp,source_flow_ocap_diversions_20090715.inp,events.dss,hist_19902007.dss,gates_db.dss,dicu_200705.dss,dicu_200905.dss,hist_19902007.dss,dicuwq_200611_expand.dss,climate-5years.dss"

CurrentTime = time()
LastRemoteHost = "slot1@xxxxxxxxxxxxxxxxxxxxxxxxx"
LocalSysCpu = 0.0
NiceUser = false
>
ClusterId = 1361
Owner = "rfinch"
RemoteUserCpu = 0.0
BufferBlockSize = 32768
MyType = "Job"
NumRestarts = 0
TransferIn = false
WindowsBuildNumber = 7600
CommittedTime = 0
JobPrio = 0
Arguments = "hydro029.inp, qual_ec029.inp"
CondorPlatform = "$CondorPlatform: x86_winnt_5.1 $"
PeriodicHold = false
WindowsProductType = 1
ExitBySignal = false
JobLeaseDuration = 300
JobStartDate = 1313858684
MachineAttrCpus0 = 1
User = "rfinch@xxxxxxxxxxxx"
LastMatchTime = 1313858825
TransferFiles = "ALWAYS"

Environment = "CLASSPATH=.;C:\Program' 'Files' '(x86)\Java\jre6\lib\ext\QTJava.zip ICPP_COMPILER11=C:\Program' 'Files' '(x86)\Intel\Compiler\11.1\065\ FLIST=d:\delta\models\studies\2010-Calibration\SensitivityTests\PtbInFiles-ManN_Ch\??? MOZ_PLUGIN_PATH=C:\Program' 'Files\Tracker' 'Software\PDF' 'Viewer\Win32\ PRINTER=dsm215rm12 PROMPT=$P$G asl.log=Destination=file; INTEL_LICENSE_FILE=C:\Program' 'Files' '(x86)\Common' 'Files\Intel\Licenses CONFIGFILE=config.inp COMSPEC=C:\Windows\system32\cmd.exe PYTHONHOME=c:\Python26 SHLVL=1 START_DATE=\"01OCT1992\" PWD=/cygdrive/d/delta/models/studies/2010-Calibration/SensitivityTests APPDATA=C:\Users\rfinch\AppData\Roaming COMPUTERNAME=BDOMO-002 SYSTEMDRIVE=C: OS=Windows_NT PROGRAMFILES=C:\Program' 'Files' '(x86) USERDNSDOMAIN=AD.WATER.CA.GOV CVS_RSH=/bin/ssh HYDROEXE=d:\delta\models\studies\2010-Calibration\SensitivityTests\hydro.exe PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC PATH=C:\cygwin\usr\local\bin;C:\cygwin\bin;C:\cygwin\bin;%DSM2_HOME%\bin;%DSM2_HOME%\vista\bin;C:\Program' 'Files\Common' 'Files\Microsoft' 'Shared\Windows' 'Live;C:\Program' 'Files' '(x86)\Common' 'Files\Microsoft' 'Shared\Windows' 'Live;C:\Program' 'Files' '(x86)\Intel\Compiler\11.1\065\lib\Intel64;C:\Program' 'Files' '(x86)\Intel\Compiler\11.1\065\lib\ia32;C:\Program' 'Files' '(x86)\Intel\Compiler\11.1\065\tbb\intel64\vc9\bin;C:\Program' 'Files' '(x86)\Intel\Compiler\11.1\065\ipp\em64t\bin;C:\Program' 'Files' '(x86)\Intel\Compiler\11.1\065\lib\Intel64;C:\Program' 'Files' '(x86)\Intel\Compiler\11.1\065\lib\ia32;C:\Program' 'Files' '(x86)\Intel\Compiler\11.1\065\mkl\em64t\bin;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program' 'Files' '(x86)\Java\jre6\bin;C:\Program' 'Files' '(x86)\Microsoft' 'SQL' 'Server\100\Tools\Binn\;C:\Program' 'Files\Microsoft' 'SQL' 'Server\100\Tools\Binn\;C:\Program' 'Files\Microsoft' 'SQL' 'Server\100\DTS\Binn\;C:\Program' 'Files' '(x86)\Microsoft' 'SQL' 'Server\90\Tools\binn\;C:\Program' 'Files' '(x86)\Subversion\bin;C:\Program' 'Files' '(x86)\TortoiseSVN\bin;C:\Program' 'Files\SlikSvn\bin\;C:\Program' 'Files\TortoiseSVN\bin;C:\Program' 'Files' '(x86)\Windows' 'Live\Shared;C:\condor\bin\;C:\Program' 'Files' '(x86)\QuickTime\QTSystem\;%DSM2_HOME%\bin;%DSM2_HOME%\vista\bin;C:\Program' 'Files\Common' 'Files\Microsoft' 'Shared\Windows' 'Live;C:\Program' 'Files' '(x86)\Common' 'Files\Microsoft' 'Shared\Windows' 'Live;C:\Program' 'Files' '(x86)\Intel\Compiler\11.1\065\lib\Intel64;C:\Program' 'Files' '(x86)\Intel\Compiler\11.1\065\lib\ia32;C:\Program' 'Files' '(x86)\Intel\Compiler\11.1\065\tbb\intel64\vc9\bin;C:\Program' 'Files' '(x86)\Intel\Compiler\11.1\065\ipp\em64t\bin;C:\Program' 'Files' '(x86)\Intel\Compiler\11.1\065\lib\Intel64;C:\Program' 'Files' '(x86)\Intel\Compiler\11.1\065\lib\ia32;C:\Program' 'Files' '(x86)\Intel\Compiler\11.1\065\mkl\em64t\bin;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program' 'Files' '(x86)\Java\jre6\bin;C:\Program' 'Files' '(x86)\Microsoft' 'SQL' 'Server\100\Tools\Binn\;C:\Program' 'Files\Microsoft' 'SQL' 'Server\100\Tools\Binn\;C:\Program' 'Files\Microsoft' 'SQL' 'Server\100\DTS\Binn\;C:\Program' 'Files' '(x86)\Microsoft' 'SQL' 'Server\90\Tools\binn\;C:\Program' 'Files' '(x86)\Subversion\bin;C:\Program' 'Files' '(x86)\TortoiseSVN\bin;C:\Program' 'Files\SlikSvn\bin\;C:\Program' 'Files\TortoiseSVN\bin;C:\Program' 'Files' '(x86)\Windows' 'Live\Shared;C:\condor\bin\;C:\Program' 'Files' '(x86)\QuickTime\QTSystem\;C:\condor\bin;C:\cygwin\bin;D:\vista\bin;C:\Programs\Python26 HOMEDRIVE=R: INFOPATH=/usr/local/info:/usr/share/info:/usr/info: VISTA_HOME=c:\programs\vista USERDOMAIN=WATER PROCESSOR_ARCHITEW6432=AMD64 UseRestart=1 DSM2RUN=HIST-CLB2K-BASE-1991-v81_0 PROCESSOR_ARCHITECTURE=x86 LOGONSERVER=\\SACDC2 WINDIR=C:\Windows HOMESHARE=\\nasbdo\modeling\rfinch QTJAVA=C:\Program' 'Files' '(x86)\Java\jre6\lib\ext\QTJava.zip OLDPWD=/cygdrive/c/Users/rfinch/Documents/My' 'Dropbox CONDORDIR=condor-ManN_Ch ProgramData=C:\ProgramData PTBDIR=PtbInFiles-ManN_Ch PROCESSOR_IDENTIFIER=Intel64' 'Family' '6' 'Model' '26' 'Stepping' '5,' 'GenuineIntel APR_ICONV_PATH=C:\Program' 'Files' '(x86)\Subversion\iconv CMNFILES=boundary_flow_calsim_delta_20090715.inp,boundary_flow_delta_historical_20090715.inp,source_flow_jones_hydro_20090806.inp,boundary_stage_adjust_astro_tide_20090715.inp,boundary_stage_delta_historical_20090715.inp,channel_historical_stability_revision_20090715.inp,channel_ic_std_delta_grid_20090715.inp,channel_planning_stability_revision_20090715.inp,channel_std_delta_grid_20090715.inp,channel_tapered_tracy_blvd_dredge_20090715.inp,gate_permanent_barriers_20090715.inp,gate_std_delta_grid_20090827.inp,gate_temp_barriers_20090715.inp,generate.py,group_rate_coeff_groups_20090715.inp,group_sourcetracking_20090715.inp,input_climate_delta_historical_climate_20090715.inp,input_gate_planning_ccfb_dcc_timing_20090715.inp,node_concentration_calsim_delta_ec_20090715.inp,node_concentration_delta_historical_do_20090715.inp,node_concentration_delta_historical_qual_20090715.inp,node_concentration_dicu_do_20090715.inp,node_concentration_dicu_ec_20090715.inp,node_concentration_jones_q ual_20090715.inp,node_concentration_mtz_planning_ec_20090715.inp,oprule_ccc_dual_intake_20090715.inp,oprule_hist_temp_barriers_20090715.inp,oprule_historical_gate_20090715.inp,oprule_montezuma_planning_gate_20090715.inp,oprule_sdip_20090715.inp,oprule_temp_barriers_planning_20090715.inp,output_channel_std_hydro_boundary_20090715.inp,output_channel_std_hydro_calib.inp,output_channel_std_qual_calib.inp,output_gate_sdip_20090715.inp,output_gate_temporary_barriers_20090715.inp,output_reservoir_std_hydro_named_20090715.inp,output_reservoir_std_qual_named_20090715.inp,output_reservoir_source_track_ec_20090715.inp,rate_coefficient_delta_ncc_20090715.inp,reservoir_concentration_dicu_ec_20090715.inp,reservoir_ic_std_delta_grid_20090715.inp,reservoir_std_delta_grid_20090715.inp,scalar_hydro_std_20090715.inp,scalar_qual_do_parameters_20090715.inp,scalar_qual_std_20090715.inp,source_flow_calsim_delta_20090715.inp,source_flow_delta_historical_20090715.inp,source_flow_dicu_20090715.inp,sou rce_flow_dicu_historical_20090715.inp,source_flow_ocap_diversions_20090715.inp ALLUSERSPROFILE=C:\ProgramData CommonProgramW6432=C:\Program' 'Files\Common' 'Files USERPROFILE=C:\Users\rfinch ROOTDIR=d:\delta\models FP_NO_HOST_CHECK=NO MANPATH=/usr/local/man:/usr/share/man:/usr/man: PRTBPREFIX=ManN_Ch TBB_ARCH_PLATFORM=intel64\vc9 ProgramW6432=C:\Program' 'Files IFORT_COMPILER11=C:\Program' 'Files' '(x86)\Intel\Compiler\11.1\065\ USER=rfinch HOSTNAME=bdomo-002 PYTHONPATH=C:\Program' 'Files' '(x86)\ArcGIS\Desktop10.0\\bin;C:\Program' 'Files' '(x86)\ArcGIS\Desktop10.0\arcpy;C:\Program' 'Files' '(x86)\ArcGIS\Desktop10.0\ArcToolbox\Scripts SESSIONNAME=Console TBB22_INSTALL_DIR=C:\Program' 'Files' '(x86)\Intel\Compiler\11.1\065\tbb TEMP=C:\Users\rfinch\AppData\Local\Temp COMMONDIR=d:\delta\models\common_input SENSDIR=d:\delta\models\studies\2010-Calibration\SensitivityTests TSFILES=events.dss,' 'hist_19902007.dss,' 'gates_db.dss,' 'dicu_200705.dss,' 'dicu_200905.dss,' 'hist_19902007.dss,' 'dicuwq_200611_expand.dss,' 'climate-5years.dss VS90COMNTOOLS=C:\Program' 'Files' '(x86)\Microsoft' 'Visual' 'Studio' '9.0\Common7\Tools\ HOME=C:\Users\rfinch\Documents\My' 'Dropbox CONDOR_RELDIR=C:\condor DSM2MODULE=\"both\" QUALEXE=d:\delta\models\studies\2010-Calibration\SensitivityTests\qual.exe _=./dsm2-run4condor.bat PROCESSOR_REVISION=1a05 TSDIR=d:\delta\models\timeseries LANG=C.UTF-8 HOMEPATH=\ CommonProgramFiles(x86)=C:\Program' 'Files' '(x86)\Common' 'Files CONDOR_CONFIG=C:\condor\condor_config PUBLIC=C:\Users\Public COMMONPROGRAMFILES=C:\Program' 'Files' '(x86)\Common' 'Files LOCALAPPDATA=C:\Users\rfinch\AppData\Local PROCESSOR_LEVEL=6 PSModulePath=C:\Windows\system32\WindowsPowerShell\v1.0\Modules\ SYSTEMROOT=C:\Windows AGSDESKTOPJAVA=C:\Program' 'Files' '(x86)\ArcGIS\Desktop10.0\ ProgramFiles(x86)=C:\Program' 'Files' '(x86) TMP=C:\Users\rfinch\AppData\Local\Temp TERM=cygwin PS1=\[\e]0;\w\a\]\n\[\e[32m\]\u@\h' '\[\e[33m\]\w\[\e[0m\]\n\$' ' USERNAME=rfinch BLOCKTYPE=GRID VS100COMNTOOLS=C:\Program' 'Files' '(x86)\Microsoft' 'Visual' 'Studio' '10.0\Common7\Tools\ NUMBER_OF_PROCESSORS=4"

Err = "dsm2-029.err"
UserLog = "D:\delta\models\studies\2010-Calibration\SensitivityTests\condor-ManN_Ch\dsm2-029.log"
ExecutableSize_RAW = 1
ExitStatus = 0
MachineAttrSlotWeight0 = 1
NTDomain = "WATER"
LastJobLeaseRenewal = 1313858826
ShouldTransferFiles = "YES"
CoreSize = 0
CumulativeSlotTime = 1.000000
MyAddress = "<136.200.32.119:49716>"
RequestDisk = DiskUsage
AutoClusterAttrs = "JobUniverse,LastCheckpointPlatform,NumCkpts,Owner,ImageSize,RequestMemory,Requirements,NiceUser,ConcurrencyLimits"
BufferSize = 524288
MinHosts = 1
JobCurrentStartDate = 1313858825
JobNotification = 2
NumCkpts_RAW = 0
RequestMemory = ceiling(ifThenElse(JobVMMemory =!= undefined,JobVMMemory,ImageSize / 1024.000000))
ShadowIpAddr = "<136.200.32.119:49716>"
StartdIpAddr = "<136.200.32.170:64632>"
TotalSuspensions = 0
TransferSocket = "<136.200.32.119:49716>"
UidDomain = "water.ca.gov"
JobLastStartDate = 1313858684
JobStatus = 2
NumSystemHolds = 0
RemoteWallClockTime = 1.000000
WhenToTransferOutput = "ON_EXIT_OR_EVICT"
Cmd = "D:\delta\models\studies\2010-Calibration\SensitivityTests\condor-ManN_Ch\condor_dsm2.bat"
PeriodicRelease = false
RequestCpus = 1
MACHINE = "bdomo-002.ad.water.ca.gov"
ProcId = 0
EnteredCurrentStatus = 1313858781
ImageSize = 1
PublicClaimId = "<136.200.32.170:64632>#1313515118#82#..."
WantRemoteIO = true
CondorVersion = "$CondorVersion: 7.6.1 May 31 2011 BuildID: 339001 $"
ImageSize_RAW = 1
AutoClusterId = 1
Out = "dsm2-029.out"
Rank = kflops
Requirements = ( ( OpSys == "WINNT51" || OpSys == "WINNT61" ) && ( Arch == "INTEL" || Arch == "X86_64" ) && ( Disk > 1000000 ) ) && ( ( TARGET.Memory * 1024 ) >= ImageSize ) && ( ( RequestMemory * 1024 ) >= ImageSize ) && ( TARGET.HasFileTransfer )
ShadowVersion = "$CondorVersion: 7.6.1 May 31 2011 BuildID: 339001 $"
CumulativeSuspensionTime = 0
OrigCmd = "D:\delta\models\studies\2010-Calibration\SensitivityTests\condor-ManN_Ch\condor_dsm2.bat"
StreamErr = false
TargetType = "Machine"
LastSuspensionTime = 0
ShadowBday = 1313858825
WantCheckpoint = false
WindowsMinorVersion = 1
WindowsServicePackMinorVersion = 0
CommittedSlotTime = 0
LastJobStatus = 1
MaxHosts = 1
NumShadowStarts = 2
QDate = 1313858575
RemoteSysCpu = 0.0
CommittedSuspensionTime = 0
DiskUsage = 475000
Iwd = "C:\Condor\execute\dir_6228"
NumJobMatches = 2
WantRemoteSyscalls = false
DiskUsage_RAW = 467967
ExecutableSize = 1
GlobalJobId = "bdomo-002.ad.water.ca.gov#1361.0#1313858575"
LastPublicClaimId = "<136.200.32.170:64632>#1313515118#71#..."
LocalUserCpu = 0.0
RemoteHost = "slot4@xxxxxxxxxxxxxxxxxxxxxxxxx"
WindowsMajorVersion = 6
WindowsServicePackMajorVersion = 0
In = "/dev/null"
RemoteSlotID = 4
CompletionDate = 0
NumJobStarts = 0
NumShadowExceptions = 1
StartdPrincipal = "unauthenticated@unmapped/136.200.32.170"
NumCkpts = 0
>
OrigIwd = "D:\delta\models\studies\2010-Calibration\SensitivityTests\condor-ManN_Ch"
_______________________________________________
Condor-users mailing list
To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/condor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/condor-users/
_______________________________________________
Condor-users mailing list
To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/condor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/condor-users/

Mailing List Archives

Authenticated access

Re: [Condor-users] Problem with multiple machines in a Windows pool