Re: [HTCondor-users] submission problem using SOAP

[Alessandro Italiano <alessandro.italiano@xxxxxxxxxx>]

Hi

taking a look at the code

https://github.com/htcondor/htcondor/blob/master/src/condor_daemon_core.V6/soap_core.cpp

I managed to bound the SSL port using the knob "SOAP_SSL_PORT = 8443â which is not presente in the doc [condor-V8_6_5-Manual.pdf]

Ale

On 23 Mar 2018, at 12:38, Alessandro Italiano <alessandro.italiano@xxxxxxxxxx> wrote:

Hi,

we are trying to use SSL SOAP WS interface in order to address a local usecase.

Client request is successfully mapped to a local user but the job is not submitted to the schedd

with a log message like this âUnknown cluster or jobâ. Iâve got the same message without SSL too

furthermore SSL PORT is not bound as supposed to be using the knob "SCHEDD_SOAP_SSL_PORT = 18443"

Any hint will be appreciated 

thanks in advance 

Ale

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%

[root@htcws ~]# condor_q -v

$CondorVersion: 8.6.5 Aug 01 2017 BuildID: 411560 $

$CondorPlatform: x86_64_RedHat7 $

[root@htcws ~]#

CONFIGURATION

ENABLE_SOAP = True

ENABLE_WEB_SERVER = True

ENABLE_SOAP_SSL = True

SCHEDD_ENABLE_SOAP_SSL = True

SCHEDD_SOAP_SSL_PORT = 18443

WEB_ROOT_DIR = /usr/share/condor/webservice/

ALLOW_SOAP = *

SOAP_LEAVE_IN_QUEUE = JobStatus == 4 && (CompletionDate =?= UNDEFINED || CompletionDate == 0 || ((CurrentTime - CompletionDate) < 7200))

QUEUE_ALL_USERS_TRUSTED = True

SOAP_SSL_SERVER_KEYFILE = /etc/certs/htcws_cert_key.pem

SOAP_SSL_CA_FILE = /etc/certs/DigiCertCA.pem

CERTIFICATE_MAPFILE = /etc/condor/mapfile

USER_MAPFILE = /etc/condor/mapfile

SCHEDD_DEBUG = D_FULLDEBUG

>>> from requests import Session

>>> from zeep import Client

>>> from zeep.transports import Transport

>>> session = Session()

>>> session.cert = '/etc/certs/soap.pem'

>>> transport = Transport(session=session)

>>> client = Client('https://htcws.recas.ba.infn.it:33751/condorSchedd.wsdl', transport=transport)

>>> client.service._binding_options['address'] = 'https://htcws.recas.ba.infn.it:33751'

>>> ts = (client.service.beginTransaction(300))

>>> ClusterId = (client.service.newCluster(ts.transaction))

>>> Job = client.service.newJob(ts.transaction, ClusterId.integer)

>>> jobTplAd = client.service.createJobTemplate(ClusterId.integer, Job.integer, type=5, cmd="/bin/sleep", args="300", owner="italiano", requirements="true")

>>> result = client.service.submit(ts.transaction, ClusterId.integer, Job.integer, jobTplAd.classAd.item)

>>> client.service.commitTransaction(ts.transaction)

{

    'code': 'SUCCESS',

    'message': 'Success',

    'next': None

}

>>> print result

{

    'status': {

        'code': 'UNKNOWNJOB',

        'message': 'Unknown cluster or job',

        'next': None

    },

    'requirements': None

}

03/23/18 11:09:46 SOAP SSL connection attempt from <90.147.168.108:0> succeeded

03/23/18 11:09:46 SOAP SSL connection from <90.147.168.108:0>, X509 subject: /DC=org/DC=terena/DC=tcs/C=IT/

03/23/18 11:09:46 SOAP SSL connection subject mapped to 'italiano'

03/23/18 11:09:46 HTTP Request: https://htcws.recas.ba.infn.it:33751/condorSchedd.wsdl

03/23/18 11:09:46 SOAP SSL connection completed

03/23/18 11:09:46 Current Socket bufsize=128k

03/23/18 11:09:46 Current Socket bufsize=128k

03/23/18 11:09:46 SOAP SSL connection attempt from <90.147.168.108:0> succeeded

03/23/18 11:09:46 SOAP SSL connection from <90.147.168.108:0>, X509 subject: /DC=org/DC=terena/DC=tcs/C=IT/

03/23/18 11:09:46 SOAP SSL connection subject mapped to 'italiano'

03/23/18 11:09:46 SOAP entered beginTransaction(), transaction: 0

03/23/18 11:09:46 SOAP leaving beginTransaction() result=0

03/23/18 11:09:46 SOAP SSL connection completed

03/23/18 11:09:46 Current Socket bufsize=128k

03/23/18 11:09:46 Current Socket bufsize=128k

03/23/18 11:09:46 SOAP SSL connection attempt from <90.147.168.108:0> succeeded

03/23/18 11:09:46 SOAP SSL connection from <90.147.168.108:0>, X509 subject: /DC=org/DC=terena/DC=tcs/C=IT/...

03/23/18 11:09:46 SOAP SSL connection subject mapped to 'italiano'

03/23/18 11:09:46 SOAP entered newCluster(), transaction: 3033688576

03/23/18 11:09:46 SOAP leaving newCluster() result=0

03/23/18 11:09:46 SOAP SSL connection completed

03/23/18 11:09:46 Current Socket bufsize=128k

03/23/18 11:09:46 Current Socket bufsize=128k

03/23/18 11:09:46 SOAP SSL connection attempt from <90.147.168.108:0> succeeded

03/23/18 11:09:46 SOAP SSL connection from <90.147.168.108:0>, X509 subject: /DC=org/DC=terena/DC=tcs/C=IT/...

03/23/18 11:09:46 SOAP SSL connection subject mapped to 'italiano'

03/23/18 11:09:46 SOAP entered newJob(), transaction: 3033688576

03/23/18 11:09:46 passwd_cache::cache_uid(): getpwnam("") failed: user not found

03/23/18 11:09:46 (2.0) Failed to find UID and GID for user . Cannot chown /var/lib/condor/spool/2/0/cluster2.proc0.subproc0 to user.

03/23/18 11:09:46 SOAP leaving newJob() result=0

03/23/18 11:09:46 SOAP SSL connection completed

03/23/18 11:09:46 Current Socket bufsize=128k

03/23/18 11:09:46 Current Socket bufsize=128k

03/23/18 11:09:46 SOAP SSL connection attempt from <90.147.168.108:0> succeeded

03/23/18 11:09:46 SOAP SSL connection from <90.147.168.108:0>, X509 subject: /DC=org/DC=terena/DC=tcs/C=IT/...

03/23/18 11:09:46 SOAP SSL connection subject mapped to 'italiano'

03/23/18 11:09:46 SOAP entered createJobTemplate(), transaction: 0

03/23/18 11:09:46 SOAP leaving createJobTemplate() result=0

03/23/18 11:09:46 SOAP SSL connection completed

03/23/18 11:09:46 Current Socket bufsize=128k

03/23/18 11:09:46 Current Socket bufsize=128k

03/23/18 11:09:46 SOAP SSL connection attempt from <90.147.168.108:0> succeeded

03/23/18 11:09:46 SOAP SSL connection from <90.147.168.108:0>, X509 subject: /DC=org/DC=terena/DC=tcs/C=IT/â.

03/23/18 11:09:46 SOAP SSL connection subject mapped to 'italiano'

03/23/18 11:09:46 SOAP entered submit(), transaction: 3033688576

03/23/18 11:09:46 SOAP leaving submit() result=4

03/23/18 11:09:46 SOAP SSL connection completed

03/23/18 11:09:47 Evaluated periodic expressions in 0.000s, scheduling next run in 61s

03/23/18 11:09:48 Current Socket bufsize=128k

03/23/18 11:09:48 Current Socket bufsize=128k

03/23/18 11:09:48 SOAP SSL connection attempt from <90.147.168.108:0> succeeded

03/23/18 11:09:48 SOAP SSL connection from <90.147.168.108:0>, X509 subject: /DC=org/DC=terena/DC=tcs/C=IT/...

03/23/18 11:09:48 SOAP SSL connection subject mapped to 'italiano'

03/23/18 11:09:48 SOAP entered commitTransaction(), transaction: 3033688576

03/23/18 11:09:48 New job: 2.0

03/23/18 11:09:48 Job has no ClusterId attribute. Skipping conversion.

03/23/18 11:09:48 New job: 2.0, Duplicate Keys: 2, Total Keys: 1

03/23/18 11:09:48 SOAP in release_data()

03/23/18 11:09:48 SOAP leaving commitTransaction() result=0

03/23/18 11:09:48 SOAP SSL connection completed

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

Attachment: smime.p7s
Description: S/MIME cryptographic signature