Mailing List Archives

Authenticated access

 		[Computer Systems Lab]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Condor-users] GSI gridmap fail on 7.6.6


Hi,

We are in the process of testing Condor version 7.6.6 with our existing
version 7.4.1.  If all go well, we will upgrade all to 7.6.6.

We are having problem with the GSI authentication part.  Looks like
the gridmap lookup of the host certificate in the gridmap is not
working properly.

The following is part of the MasterLog:

02/09/12 09:17:50 This process has a valid certificate & key
02/09/12 09:17:50 Adding to resolved authorization table: gsi@unmapped/10.3.255.107: DENY_DAEMON 02/09/12 09:17:50 PERMISSION DENIED to gsi@unmapped from host 10.3.255.107 for command 60008 (DC_CHILDALIVE), access level DAEMON: reason: DAEMON authorization policy contains no matching ALLOW entry for this request; identifiers used for this host: 10.3.255.107,compute-10-33.local,compute-10-33 02/09/12 09:17:50 PERMISSION DENIED to gsi@unmapped from host 10.3.255.107 for command 60008 (DC_CHILDALIVE), access level DAEMON: reason: cached result for DAEMON; see first case for the full reason 


The following is part of the StartLog:
02/09/12 09:20:23 PERMISSION DENIED to gsi@unmapped from host 10.3.255.168 for command 442 (REQUEST_CLAIM), access level DAEMON: reason: DAEMON authorization policy contains no matching ALLOW entry for this request; identifiers used for this host: 10.3.255.168,gatekeeper-13-12.local 


The following is security section of the condor_config file:

SEC_DAEMON_AUTHENTICATION = REQUIRED
SEC_DAEMON_INTEGRITY = REQUIRED
SEC_DAEMON_AUTHENTICATION_METHODS = GSI
SEC_NEGOTIATOR_AUTHENTICATION = REQUIRED
SEC_NEGOTIATOR_INTEGRITY = REQUIRED
SEC_NEGOTIATOR_AUTHENTICATION_METHODS = GSISEC_DAEMON_AUTHENTICATION = REQUIRED 
SEC_DAEMON_INTEGRITY = REQUIRED
SEC_DAEMON_AUTHENTICATION_METHODS = GSI
SEC_NEGOTIATOR_AUTHENTICATION = REQUIRED
SEC_NEGOTIATOR_INTEGRITY = REQUIRED
SEC_NEGOTIATOR_AUTHENTICATION_METHODS = GSI

ALLOW_DAEMON = *@ultralight.org/*.ultralight.org
ALLOW_NEGOTIATOR = *@ultralight.org/*.ultralight.org

GSI_DAEMON_DIRECTORY      = /etc/grid-security
GSI_DAEMON_CERT           = $(GSI_DAEMON_DIRECTORY)/condorcert.pem
GSI_DAEMON_KEY            = $(GSI_DAEMON_DIRECTORY)/condorkey.pem
GSI_DAEMON_TRUSTED_CA_DIR = $(GSI_DAEMON_DIRECTORY)/certificates
#GSI_DAEMON_TRUSTED_CA_DIR = /etc/grid-security/certificates
GSI_NEGOTIATOR_TRUSTED_CA_DIR = /etc/grid-security/certificates
GSI_DAEMON_NAME = /DC=org/DC=doegrids/OU=Services/CN=compute-10-33.ultralight.org,/DC=org/DC=doegrids/OU=Services/CN=compute-13-1.ultralight.org 
GRIDMAP                   = /etc/grid-security/grid-mapfile


The following is the certificate subject for the test host:

Subject: DC=org, DC=doegrids, OU=Services, CN=compute-10-33.ultralight.org



We've also attached the MasterLog.debug file and the grid-mapfile.


Thanks in advance for your help.

Steven Lo
  Caltech CMS Tier2 Administrator



02/09/12 09:17:43 Reading from /proc/cpuinfo
02/09/12 09:17:43 Found: Physical-IDs:True; Core-IDs:True
02/09/12 09:17:43 Analyzing 4 processors using IDs...
02/09/12 09:17:43 Looking at processor #0 (PID:0, CID:0):
02/09/12 09:17:43 Comparing P#0   and P#1  : pid:0!=3 or  cid:0!=0 (match=No)
02/09/12 09:17:43 Comparing P#0   and P#2  : pid:0!=0 or  cid:0!=1 (match=No)
02/09/12 09:17:43 Comparing P#0   and P#3  : pid:0!=3 or  cid:0!=1 (match=No)
02/09/12 09:17:43 ncpus = 1
02/09/12 09:17:43 P0: match->1
02/09/12 09:17:43 Looking at processor #1 (PID:3, CID:0):
02/09/12 09:17:43 Comparing P#1   and P#2  : pid:3!=0 or  cid:0!=1 (match=No)
02/09/12 09:17:43 Comparing P#1   and P#3  : pid:3!=3 or  cid:0!=1 (match=No)
02/09/12 09:17:43 ncpus = 2
02/09/12 09:17:43 P1: match->1
02/09/12 09:17:43 Looking at processor #2 (PID:0, CID:1):
02/09/12 09:17:43 Comparing P#2   and P#3  : pid:0!=3 or  cid:1!=1 (match=No)
02/09/12 09:17:43 ncpus = 3
02/09/12 09:17:43 P2: match->1
02/09/12 09:17:43 Looking at processor #3 (PID:3, CID:1):
02/09/12 09:17:43 ncpus = 4
02/09/12 09:17:43 P3: match->1
02/09/12 09:17:43 Using IDs: 4 processors, 4 CPUs, 0 HTs
02/09/12 09:17:43 Disabling ConvertDefaultIPToSocketIP() because NETWORK_INTERFACE does not match multiple IPs.
02/09/12 09:17:43 Setting maximum accepts per cycle 4.
02/09/12 09:17:43 ******************************************************
02/09/12 09:17:43 ** condor_master (CONDOR_MASTER) STARTING UP
02/09/12 09:17:43 ** /usr/sbin/condor_master
02/09/12 09:17:43 ** SubsystemInfo: name=MASTER type=MASTER(2) class=DAEMON(1)
02/09/12 09:17:43 ** Configuration: subsystem:MASTER local:<NONE> class:DAEMON
02/09/12 09:17:43 ** $CondorVersion: 7.6.6 Jan 17 2012 BuildID: 401976 $
02/09/12 09:17:43 ** $CondorPlatform: x86_64_rhap_5 $
02/09/12 09:17:43 ** PID = 8092
02/09/12 09:17:43 ** Log last touched time unavailable (No such file or directory)
02/09/12 09:17:43 ******************************************************
02/09/12 09:17:43 Using config source: /etc/condor/condor_config
02/09/12 09:17:43 Using local config sources: 
02/09/12 09:17:43    /share/apps/condor/hosts/compute-10-33/condor_config.local
02/09/12 09:17:43 Running as root.  Enabling specialized core dump routines
02/09/12 09:17:43 Attempting to lock /var/lock/condor/InstanceLock.
02/09/12 09:17:43 FileLock object is updating timestamp on: /var/lock/condor/InstanceLock
02/09/12 09:17:43 FileLock::obtain(1) - @1328807863.398303 lock on /var/lock/condor/InstanceLock now WRITE
02/09/12 09:17:43 Obtained lock on /var/lock/condor/InstanceLock.
02/09/12 09:17:43 Not using shared port because USE_SHARED_PORT=false
02/09/12 09:17:43 DaemonCore: command socket at <10.3.255.107:57654>
02/09/12 09:17:43 DaemonCore: private command socket at <10.3.255.107:57654>
02/09/12 09:17:43 Setting maximum accepts per cycle 4.
02/09/12 09:17:43 Will use UDP to update collector compute-13-1.local <10.3.255.252:9618>
02/09/12 09:17:43 Not using shared port because USE_SHARED_PORT=false
02/09/12 09:17:43 ::RealStart; STARTD on_hold=0
02/09/12 09:17:43 SharedPortEndpoint: Inside destructor.
02/09/12 09:17:43 Started DaemonCore process "/usr/sbin/condor_startd -f", pid and pgroup = 8093
02/09/12 09:17:43 FileLock object is updating timestamp on: /var/lock/condor/InstanceLock
02/09/12 09:17:43 Getting monitoring info for pid 8092
02/09/12 09:17:45 ProcAPI::buildFamily() Found daddypid on the system: 8093
02/09/12 09:17:48 enter Daemons::UpdateCollector
02/09/12 09:17:48 Trying to update collector <10.3.255.252:9618>
02/09/12 09:17:48 Attempting to send update via UDP to collector compute-13-1.local <10.3.255.252:9618>
02/09/12 09:17:48 File descriptor limits: max 1024, safe 820
02/09/12 09:17:48 exit Daemons::UpdateCollector
02/09/12 09:17:48 enter Daemons::CheckForNewExecutable
02/09/12 09:17:48 Time stamp of running /usr/sbin/condor_master: 1326823785
02/09/12 09:17:48 GetTimeStamp returned: 1326823785
02/09/12 09:17:48 Time stamp of running /usr/sbin/condor_startd: 1326823790
02/09/12 09:17:48 GetTimeStamp returned: 1326823790
02/09/12 09:17:48 exit Daemons::CheckForNewExecutable
02/09/12 09:17:48 This process has a valid certificate & key
02/09/12 09:17:48 Initialized the following authorization table:
02/09/12 09:17:48 Authorizations yet to be resolved:
02/09/12 09:17:48 allow NEGOTIATOR:  *@ultralight.org/*.ultralight.org
02/09/12 09:17:48 allow ADMINISTRATOR:  */10.3.255.252 */compute-13-1.local
02/09/12 09:17:48 allow OWNER:  */10.3.255.107 */10.3.255.252 */compute-13-1.local */compute-10-33.local
02/09/12 09:17:48 allow DAEMON:  *@ultralight.org/*.ultralight.org
02/09/12 09:17:48 allow ADVERTISE_STARTD:  *@ultralight.org/*.ultralight.org
02/09/12 09:17:48 allow ADVERTISE_SCHEDD:  *@ultralight.org/*.ultralight.org
02/09/12 09:17:48 allow ADVERTISE_MASTER:  *@ultralight.org/*.ultralight.org
02/09/12 09:17:50 This process has a valid certificate & key
02/09/12 09:17:50 Adding to resolved authorization table: gsi@unmapped/10.3.255.107: DENY_DAEMON
02/09/12 09:17:50 PERMISSION DENIED to gsi@unmapped from host 10.3.255.107 for command 60008 (DC_CHILDALIVE), access level DAEMON: reason: DAEMON authorization policy contains no matching ALLOW entry for this request; identifiers used for this host: 10.3.255.107,compute-10-33.local,compute-10-33
02/09/12 09:17:50 PERMISSION DENIED to gsi@unmapped from host 10.3.255.107 for command 60008 (DC_CHILDALIVE), access level DAEMON: reason: cached result for DAEMON; see first case for the full reason
02/09/12 09:18:45 ProcAPI::buildFamily() Found daddypid on the system: 8093
02/09/12 09:18:45 ProcAPI::getProcInfo() pid 8100 does not exist.
02/09/12 09:18:45 ProcAPI::getProcInfo() pid 8100 does not exist.
02/09/12 09:18:45 ProcAPI::getProcInfo() pid 8100 does not exist.
02/09/12 09:18:45 ProcAPI::getProcInfo() pid 8100 does not exist.
02/09/12 09:18:45 ProcAPI::getProcInfo() pid 8100 does not exist.
02/09/12 09:18:45 ProcAPI::getProcInfo() pid 8101 does not exist.
02/09/12 09:18:45 ProcAPI::getProcInfo() pid 8101 does not exist.
02/09/12 09:18:45 ProcAPI::getProcInfo() pid 8101 does not exist.
02/09/12 09:18:45 ProcAPI::getProcInfo() pid 8101 does not exist.
02/09/12 09:18:45 ProcAPI::getProcInfo() pid 8101 does not exist.
02/09/12 09:19:45 ProcAPI::buildFamily() Found daddypid on the system: 8093
02/09/12 09:20:45 ProcAPI::buildFamily() Found daddypid on the system: 8093

"/DC=org/DC=doegrids/OU=Services/CN=cithep195.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=cithep231.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=cithep252.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=cithep251.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-5.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-6.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-7.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-8.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-9.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-10.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-11.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-12.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-13.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-14.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-15.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-16.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-17.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-18.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-19.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-20.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-21.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-22.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-23.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-24.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-27.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-28.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-29.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-30.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-31.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-32.ultralight.org" condor@xxxxxxxxxxxxxx
/DC=org/DC=doegrids/OU=Services/CN=compute-10-33.ultralight.org condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-34.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-10-35.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-11-8.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-11-9.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-11-10.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-11-11.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-11-12.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-11-13.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-11-14.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-11-15.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-11-16.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-11-17.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-11-18.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-11-19.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-11-20.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-11-21.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-11-22.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-11-23.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-11-24.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-9.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-10.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-11.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-12.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-13.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-14.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-15.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-16.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-17.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-18.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-19.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-20.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-21.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-22.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-23.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-24.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-25.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-26.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-27.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-28.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-29.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-30.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-31.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-32.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-33.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-34.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-35.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-36.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-37.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-38.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-39.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-40.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-41.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-12-42.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-13-1.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-13-3.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-13-13.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-13-14.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-13-15.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-13-16.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-13-17.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-13-18.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-13-19.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-13-20.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-13-21.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-13-22.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-13-23.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-13-24.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-13-25.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=nas-13-5.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=nas-13-6.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-1.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-2.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-3.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-4.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-5.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-6.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-7.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-8.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-9.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-10.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-11.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-12.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-13.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-14.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-15.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-16.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-17.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-18.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-19.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-20.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-21.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-22.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-23.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-24.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-25.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-26.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-27.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-28.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-29.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-30.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-31.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-32.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-33.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-34.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-35.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-36.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-37.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-38.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-39.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-40.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-41.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-42.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-43.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-44.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-45.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-46.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-47.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-48.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-49.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-50.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-51.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-52.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-53.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-54.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-55.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-56.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-57.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-58.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-59.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-60.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-61.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-62.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-63.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-14-64.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-1.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-2.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-3.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-4.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-5.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-6.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-7.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-8.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-9.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-10.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-11.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-12.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-13.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-14.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-15.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-16.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-17.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-18.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-19.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-20.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-25.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-26.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-27.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-28.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-29.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-30.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-31.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-16-32.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-1.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-2.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-3.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-4.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-5.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-6.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-7.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-8.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-9.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-10.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-11.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-12.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-13.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-14.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-15.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-16.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-17.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-18.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-19.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-20.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-21.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-22.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-23.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-24.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-25.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-26.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-27.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-28.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-29.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-30.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-31.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-32.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-33.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-34.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-35.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-36.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-37.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-38.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-39.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-40.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-41.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-42.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-43.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-20-44.ultralight.org" condor@xxxxxxxxxxxxxx
"/DC=org/DC=doegrids/OU=Services/CN=compute-21-6.ultralight.org" condor@xxxxxxxxxxxxxx

Attachment: smime.p7s
Description: S/MIME Cryptographic Signature