Further clarification: I’m now setting up my daemon without using htcondor python binding, and the daemon no longer shows mysterious hang or segfault. From: Xin Wang I was trying to use htcondor to distribute jobs to a pool of machines, and would like to get the job status update and take proper actions as soon as the state update happens. For this purpose, I use htcondor python bindings to implement
a simple daemon. Essentially I use htcondor.submit() to submit tasks, and use htcondor.read_events to read the update. Initially I compiled htcondor 8.6.6 manually to get a python bindings for python 3.6. The daemon worked properly for a couple of hours but then would hang mysteriously at impossible places and I have to use “kill -9” to kill the process
(it does not respond to kill) every single time. The followings are a few examples, and the last line is where the python script hangs. condorserver.py(152): for job in jobs: condorserver.py(153): if job[0].lower() == "submit": _strptime.py(560): return time.struct_time(tt[:time._STRUCT_TM_ITEMS]) condorlog.py(30): if ctime < self.ctime: condorlog.py(34): return now, ctime condorserver.py(236): print("DEBUG-6 add ({}, {}, {}, {}, {}) to updates".format(tag, task, timestamp, tsupdate, status), flush=True) condorserver.py(193): for event in myevents: I sensed that the manually compiled modules may malfunction, so I tried the python bindings installed by RPM. It also had issues. Instead of hanging, it crashed (at a place where a new list is being created in python): condorserver.py(205): print(batch) condorserver.py(206): params = list() *** glibc detected *** python: corrupted double-linked list: 0x0000000002617b80 *** ======= Backtrace: ========= /lib64/libc.so.6[0x3ded675f4e] /lib64/libc.so.6[0x3ded679066] /usr/lib64/libpython2.6.so.1.0[0x3df5aa1b79] /usr/lib64/libpython2.6.so.1.0[0x3df5a79e3b] /usr/lib64/libpython2.6.so.1.0[0x3df5a90d5d] /usr/lib64/libpython2.6.so.1.0[0x3df5a70aef] /usr/lib64/libpython2.6.so.1.0[0x3df5a78277] /usr/lib64/libpython2.6.so.1.0(PyDict_SetItem+0xa7)[0x3df5a7ace7] /usr/lib64/libpython2.6.so.1.0(PyEval_EvalFrameEx+0x547c)[0x3df5ad5c0c] /usr/lib64/libpython2.6.so.1.0(PyEval_EvalCodeEx+0x927)[0x3df5ad7647] /usr/lib64/libpython2.6.so.1.0(PyEval_EvalCode+0x32)[0x3df5ad7722] /usr/lib64/libpython2.6.so.1.0(PyEval_EvalFrameEx+0x54f2)[0x3df5ad5c82] /usr/lib64/libpython2.6.so.1.0(PyEval_EvalCodeEx+0x927)[0x3df5ad7647] /usr/lib64/libpython2.6.so.1.0(PyEval_EvalFrameEx+0x5304)[0x3df5ad5a94] /usr/lib64/libpython2.6.so.1.0(PyEval_EvalCodeEx+0x927)[0x3df5ad7647] /usr/lib64/libpython2.6.so.1.0(PyEval_EvalFrameEx+0x5304)[0x3df5ad5a94] /usr/lib64/libpython2.6.so.1.0(PyEval_EvalCodeEx+0x927)[0x3df5ad7647] /usr/lib64/libpython2.6.so.1.0(PyEval_EvalCode+0x32)[0x3df5ad7722] /usr/lib64/libpython2.6.so.1.0(PyEval_EvalFrameEx+0x54f2)[0x3df5ad5c82] /usr/lib64/libpython2.6.so.1.0(PyEval_EvalCodeEx+0x927)[0x3df5ad7647] /usr/lib64/libpython2.6.so.1.0(PyEval_EvalFrameEx+0x5304)[0x3df5ad5a94] /usr/lib64/libpython2.6.so.1.0(PyEval_EvalCodeEx+0x927)[0x3df5ad7647] /usr/lib64/libpython2.6.so.1.0[0x3df5a6aca0] /usr/lib64/libpython2.6.so.1.0(PyObject_Call+0x53)[0x3df5a43c63] /usr/lib64/libpython2.6.so.1.0[0x3df5afeb7e] /usr/lib64/libpython2.6.so.1.0(Py_Main+0x793)[0x3df5aff4c3] /lib64/libc.so.6(__libc_start_main+0xfd)[0x3ded61ed5d] python[0x400649] ======= Memory map: ======== 00400000-00401000 r-xp 00000000 fd:01 793246 /usr/bin/python 00600000-00602000 rw-p 00000000 fd:01 793246 /usr/bin/python 01b8e000-02641000 rw-p 00000000 00:00 0 [heap] 3cae800000-3cae9b9000 r-xp 00000000 fd:01 835543 /usr/lib64/libcrypto.so.1.0.1e 3cae9b9000-3caebb8000 ---p 001b9000 fd:01 835543 /usr/lib64/libcrypto.so.1.0.1e 3caebb8000-3caebd3000 r--p 001b8000 fd:01 835543 /usr/lib64/libcrypto.so.1.0.1e 3caebd3000-3caebdf000 rw-p 001d3000 fd:01 835543 /usr/lib64/libcrypto.so.1.0.1e 3caebdf000-3caebe3000 rw-p 00000000 00:00 0 3caec00000-3caf006000 r-xp 00000000 fd:01 835546 /usr/lib64/libcondor_utils_8_6_6.so 3caf006000-3caf206000 ---p 00406000 fd:01 835546 /usr/lib64/libcondor_utils_8_6_6.so 3caf206000-3caf229000 rw-p 00406000 fd:01 835546 /usr/lib64/libcondor_utils_8_6_6.so 3caf229000-3caf230000 rw-p 00000000 00:00 0 3caf400000-3caf491000 r-xp 00000000 fd:01 830692 /usr/lib64/libclassad.so.8.6.6 3caf491000-3caf690000 ---p 00091000 fd:01 830692 /usr/lib64/libclassad.so.8.6.6 3caf690000-3caf694000 rw-p 00090000 fd:01 830692 /usr/lib64/libclassad.so.8.6.6 3caf800000-3caf862000 r-xp 00000000 fd:01 835544 /usr/lib64/libssl.so.1.0.1e 3caf862000-3cafa61000 ---p 00062000 fd:01 835544 /usr/lib64/libssl.so.1.0.1e 3cafa61000-3cafa65000 r--p 00061000 fd:01 835544 /usr/lib64/libssl.so.1.0.1e 3cafa65000-3cafa6c000 rw-p 00065000 fd:01 835544 /usr/lib64/libssl.so.1.0.1e 3cafc00000-3cafc10000 r-xp 00000000 fd:01 831719 /usr/lib64/libglobus_gsi_credential.so.1.6.9 3cafc10000-3cafe10000 ---p 00010000 fd:01 831719 /usr/lib64/libglobus_gsi_credential.so.1.6.9 3cafe10000-3cafe11000 rw-p 00010000 fd:01 831719 /usr/lib64/libglobus_gsi_credential.so.1.6.9 3cb0000000-3cb000b000 r-xp 00000000 fd:01 831718 /usr/lib64/libglobus_gsi_callback.so.0.5.8 3cb000b000-3cb020a000 ---p 0000b000 fd:01 831718 /usr/lib64/libglobus_gsi_callback.so.0.5.8 3cb020a000-3cb020b000 rw-p 0000a000 fd:01 831718 /usr/lib64/libglobus_gsi_callback.so.0.5.8 3cb0400000-3cb041f000 r-xp 00000000 fd:01 831721 /usr/lib64/libglobus_gssapi_gsi.so.4.7.25 3cb041f000-3cb061e000 ---p 0001f000 fd:01 831721 /usr/lib64/libglobus_gssapi_gsi.so.4.7.25 3cb061e000-3cb0620000 rw-p 0001e000 fd:01 831721 /usr/lib64/libglobus_gssapi_gsi.so.4.7.25 3cb0c00000-3cb0c04000 r-xp 00000000 fd:01 835545 /usr/lib64/libglobus_openssl_error.so.0.3.5 3cb0c04000-3cb0e03000 ---p 00004000 fd:01 835545 /usr/lib64/libglobus_openssl_error.so.0.3.5 3cb0e03000-3cb0e04000 rw-p 00003000 fd:01 835545 /usr/lib64/libglobus_openssl_error.so.0.3.5 3cb1000000-3cb1008000 r-xp 00000000 fd:01 831717 /usr/lib64/libglobus_oldgaa.so.0.5.8 3cb1008000-3cb1208000 ---p 00008000 fd:01 831717 /usr/lib64/libglobus_oldgaa.so.0.5.8 3cb1208000-3cb1209000 rw-p 00008000 fd:01 831717 /usr/lib64/libglobus_oldgaa.so.0.5.8 3cb1800000-3cb1805000 r-xp 00000000 fd:01 831716 /usr/lib64/libglobus_gsi_cert_utils.so.0.9.11 3cb1805000-3cb1a04000 ---p 00005000 fd:01 831716 /usr/lib64/libglobus_gsi_cert_utils.so.0.9.11 3cb1a04000-3cb1a05000 rw-p 00004000 fd:01 831716 /usr/lib64/libglobus_gsi_cert_utils.so.0.9.11 3cb1c00000-3cb1c02000 r-xp 00000000 fd:01 831715 /usr/lib64/libglobus_openssl.so.0.4.6 3cb1c02000-3cb1e01000 ---p 00002000 fd:01 831715 /usr/lib64/libglobus_openssl.so.0.4.6 3cb1e01000-3cb1e02000 rw-p 00001000 fd:01 831715 /usr/lib64/libglobus_openssl.so.0.4.6 3cb2000000-3cb2004000 r-xp 00000000 fd:01 831714 /usr/lib64/libglobus_proxy_ssl.so.1.4.7 3cb2004000-3cb2204000 ---p 00004000 fd:01 831714 /usr/lib64/libglobus_proxy_ssl.so.1.4.7 3cb2204000-3cb2205000 rw-p 00004000 fd:01 831714 /usr/lib64/libglobus_proxy_ssl.so.1.4.7 3dece00000-3dece20000 r-xp 00000000 fd:01 408732 /lib64/ld-2.12.so 3ded01f000-3ded020000 r--p 0001f000 fd:01 408732 /lib64/ld-2.12.so 3ded020000-3ded021000 rw-p 00020000 fd:01 408732 /lib64/ld-2.12.so 3ded021000-3ded022000 rw-p 00000000 00:00 0 3ded200000-3ded283000 r-xp 00000000 fd:01 408744 /lib64/libm-2.12.so 3ded283000-3ded482000 ---p 00083000 fd:01 408744 /lib64/libm-2.12.so 3ded482000-3ded483000 r--p 00082000 fd:01 408744 /lib64/libm-2.12.so 3ded483000-3ded484000 rw-p 00083000 fd:01 408744 /lib64/libm-2.12.so 3ded600000-3ded78a000 r-xp 00000000 fd:01 408733 /lib64/libc-2.12.so 3ded78a000-3ded98a000 ---p 0018a000 fd:01 408733 /lib64/libc-2.12.so 3ded98a000-3ded98e000 r--p 0018a000 fd:01 408733 /lib64/libc-2.12.so 3ded98e000-3ded98f000 rw-p 0018e000 fd:01 408733 /lib64/libc-2.12.so 3ded98f000-3ded994000 rw-p 00000000 00:00 0 3deda00000-3deda17000 r-xp 00000000 fd:01 408734 /lib64/libpthread-2.12.so 3deda17000-3dedc17000 ---p 00017000 fd:01 408734 /lib64/libpthread-2.12.so 3dedc17000-3dedc18000 r--p 00017000 fd:01 408734 /lib64/libpthread-2.12.so 3dedc18000-3dedc19000 rw-p 00018000 fd:01 408734 /lib64/libpthread-2.12.so 3dedc19000-3dedc1d000 rw-p 00000000 00:00 0 3dede00000-3dede02000 r-xp 00000000 fd:01 408739 /lib64/libdl-2.12.so 3dede02000-3dee002000 ---p 00002000 fd:01 408739 /lib64/libdl-2.12.so 3dee002000-3dee003000 r--p 00002000 fd:01 408739 /lib64/libdl-2.12.so 3dee003000-3dee004000 rw-p 00003000 fd:01 408739 /lib64/libdl-2.12.so 3dee200000-3dee215000 r-xp 00000000 fd:01 408741 /lib64/libz.so.1.2.3 3dee215000-3dee414000 ---p 00015000 fd:01 408741 /lib64/libz.so.1.2.3 3dee414000-3dee415000 r--p 00014000 fd:01 408741 /lib64/libz.so.1.2.3 3dee415000-3dee416000 rw-p 00015000 fd:01 408741 /lib64/libz.so.1.2.3 3dee600000-3dee607000 r-xp 00000000 fd:01 408735 /lib64/librt-2.12.so 3dee607000-3dee806000 ---p 00007000 fd:01 408735 /lib64/librt-2.12.so 3dee806000-3dee807000 r--p 00006000 fd:01 408735 /lib64/librt-2.12.so 3dee807000-3dee808000 rw-p 00007000 fd:01 408735 /lib64/librt-2.12.so 3deea00000-3deea1d000 r-xp 00000000 fd:01 408742 /lib64/libselinux.so.1 3deea1d000-3deec1c000 ---p 0001d000 fd:01 408742 /lib64/libselinux.so.1 3deec1c000-3deec1d000 r--p 0001c000 fd:01 408742 /lib64/libselinux.so.1 3deec1d000-3deec1e000 rw-p 0001d000 fd:01 408742 /lib64/libselinux.so.1 3deec1e000-3deec1f000 rw-p 00000000 00:00 0 3def200000-3def216000 r-xp 00000000 fd:01 393310 /lib64/libresolv-2.12.so 3def216000-3def416000 ---p 00016000 fd:01 393310 /lib64/libresolv-2.12.so 3def416000-3def417000 r--p 00016000 fd:01 393310 /lib64/libresolv-2.12.so 3def417000-3def418000 rw-p 00017000 fd:01 393310 /lib64/libresolv-2.12.so 3def418000-3def41a000 rw-p 00000000 00:00 0 3defe00000-3defe26000 r-xp 00000000 fd:01 408745 /lib64/libexpat.so.1.5.2 3defe26000-3df0025000 ---p 00026000 fd:01 408745 /lib64/libexpat.so.1.5.2 3df0025000-3df0028000 rw-p 00025000 fd:01 408745 /lib64/libexpat.so.1.5.2 3df0a00000-3df0a04000 r-xp 00000000 fd:01 831723 /usr/lib64/libglobus_callout.so.0.3.13 3df0a04000-3df0c04000 ---p 00004000 fd:01 831723 /usr/lib64/libglobus_callout.so.0.3.13 3df0c04000-3df0c05000 rw-p 00004000 fd:01 831723 /usr/lib64/libglobus_callout.so.0.3.13 3df1600000-3df1647000 r-xp 00000000 fd:01 831712 /usr/lib64/libglobus_common.so.0.16.0 3df1647000-3df1847000 ---p 00047000 fd:01 831712 /usr/lib64/libglobus_common.so.0.16.0 3df1847000-3df184a000 rw-p 00047000 fd:01 831712 /usr/lib64/libglobus_common.so.0.16.0 3df184a000-3df184c000 rw-p 00000000 00:00 0 3df1a00000-3df1a16000 r-xp 00000000 fd:01 408746 /lib64/libgcc_s-4.4.7-20120601.so.1 3df1a16000-3df1c15000 ---p 00016000 fd:01 408746 /lib64/libgcc_s-4.4.7-20120601.so.1 3df1c15000-3df1c16000 rw-p 00015000 fd:01 408746 /lib64/libgcc_s-4.4.7-20120601.so.1 3df2e00000-3df2e60000 r-xp 00000000 fd:01 831711 /usr/lib64/libvomsapi.so.1.0.0 3df2e60000-3df3060000 ---p 00060000 fd:01 831711 /usr/lib64/libvomsapi.so.1.0.0 3df3060000-3df3063000 rw-p 00060000 fd:01 831711 /usr/lib64/libvomsapi.so.1.0.0 3df3a00000-3df3ae8000 r-xp 00000000 fd:01 792176 /usr/lib64/libstdc++.so.6.0.13 3df3ae8000-3df3ce8000 ---p 000e8000 fd:01 792176 /usr/lib64/libstdc++.so.6.0.13 3df3ce8000-3df3cef000 r--p 000e8000 fd:01 792176 /usr/lib64/libstdc++.so.6.0.13 3df3cef000-3df3cf1000 rw-p 000ef000 fd:01 792176 /usr/lib64/libstdc++.so.6.0.13 3df3cf1000-3df3d06000 rw-p 00000000 00:00 0 3df4a00000-3df4a15000 r-xp 00000000 fd:01 795149 /usr/lib64/libgomp.so.1.0.0 3df4a15000-3df4c14000 ---p 00015000 fd:01 795149 /usr/lib64/libgomp.so.1.0.0 3df4c14000-3df4c15000 rw-p 00014000 fd:01 795149 /usr/lib64/libgomp.so.1.0.0 3df4e00000-3df4e03000 r-xp 00000000 fd:01 408750 /lib64/libcom_err.so.2.1 3df4e03000-3df5002000 ---p 00003000 fd:01 408750 /lib64/libcom_err.so.2.1 3df5002000-3df5003000 r--p 00002000 fd:01 408750 /lib64/libcom_err.so.2.1 3df5003000-3df5004000 rw-p 00003000 fd:01 408750 /lib64/libcom_err.so.2.1 3df5200000-3df52db000 r-xp 00000000 fd:01 408751 /lib64/libkrb5.so.3.3 3df52db000-3df54db000 ---p 000db000 fd:01 408751 /lib64/libkrb5.so.3.3 3df54db000-3df54e5000 r--p 000db000 fd:01 408751 /lib64/libkrb5.so.3.3 3df54e5000-3df54e7000 rw-p 000e5000 fd:01 408751 /lib64/libkrb5.so.3.3 3df5600000-3df5602000 r-xp 00000000 fd:01 408747 /lib64/libkeyutils.so.1.3 3df5602000-3df5801000 ---p 00002000 fd:01 408747 /lib64/libkeyutils.so.1.3 3df5801000-3df5802000 r--p 00001000 fd:01 408747 /lib64/libkeyutils.so.1.3 3df5802000-3df5803000 rw-p 00002000 fd:01 408747 /lib64/libkeyutils.so.1.3 3df5a00000-3df5b5d000 r-xp 00000000 fd:01 817253 /usr/lib64/libpython2.6.so.1.0 3df5b5d000-3df5d5c000 ---p 0015d000 fd:01 817253 /usr/lib64/libpython2.6.so.1.0 3df5d5c000-3df5d98000 rw-p 0015c000 fd:01 817253 /usr/lib64/libpython2.6.so.1.0 3df5d98000-3df5da6000 rw-p 00000000 00:00 0 3df5e00000-3df5e29000 r-xp 00000000 fd:01 408749 /lib64/libk5crypto.so.3.1 3df5e29000-3df6029000 ---p 00029000 fd:01 408749 /lib64/libk5crypto.so.3.1 3df6029000-3df602a000 r--p 00029000 fd:01 408749 /lib64/libk5crypto.so.3.1 3df602a000-3df602b000 rw-p 0002a000 fd:01 408749 /lib64/libk5crypto.so.3.1 3df602b000-3df602c000 rw-p 00000000 00:00 0 3df6200000-3df6241000 r-xp 00000000 fd:01 408752 /lib64/libgssapi_krb5.so.2.2 3df6241000-3df6441000 ---p 00041000 fd:01 408752 /lib64/libgssapi_krb5.so.2.2 3df6441000-3df6442000 r--p 00041000 fd:01 408752 /lib64/libgssapi_krb5.so.2.2 3df6442000-3df6444000 rw-p 00042000 fd:01 408752 /lib64/libgssapi_krb5.so.2.2 3dfc600000-3dfc609000 r-xp 00000000 fd:01 790304 /usr/lib64/libltdl.so.7.2.1 3dfc609000-3dfc808000 ---p 00009000 fd:01 790304 /usr/lib64/libltdl.so.7.2.1 3dfc808000-3dfc809000 rw-p 00008000 fd:01 790304 /usr/lib64/libltdl.so.7.2.1 3dfdc00000-3dfdc02000 r-xp 00000000 fd:01 393306 /lib64/libutil-2.12.so 3dfdc02000-3dfde01000 ---p 00002000 fd:01 393306 /lib64/libutil-2.12.so 3dfde01000-3dfde02000 r--p 00001000 fd:01 393306 /lib64/libutil-2.12.so 3dfde02000-3dfde03000 rw-p 00002000 fd:01 393306 /lib64/libutil-2.12.so 3e00000000-3e0002c000 r-xp 00000000 fd:01 408759 /lib64/libpcre.so.0.0.1 3e0002c000-3e0022c000 ---p 0002c000 fd:01 408759 /lib64/libpcre.so.0.0.1 3e0022c000-3e0022d000 rw-p 0002c000 fd:01 408759 /lib64/libpcre.so.0.0.1 7f71a0000000-7f71a0021000 rw-p 00000000 00:00 0 7f71a0021000-7f71a4000000 ---p 00000000 00:00 0 7f71a4000000-7f71a4021000 rw-p 00000000 00:00 0 7f71a4021000-7f71a8000000 ---p 00000000 00:00 0 7f71a8000000-7f71a8021000 rw-p 00000000 00:00 0 7f71a8021000-7f71ac000000 ---p 00000000 00:00 0 7f71ac6f1000-7f71ac6fe000 r-xp 00000000 fd:01 831722 /usr/lib64/libglobus_gss_assist.so.3.7.15 7f71ac6fe000-7f71ac8fd000 ---p 0000d000 fd:01 831722 /usr/lib64/libglobus_gss_assist.so.3.7.15 7f71ac8fd000-7f71ac8fe000 rw-p 0000c000 fd:01 831722 /usr/lib64/libglobus_gss_assist.so.3.7.15 7f71ac8fe000-7f71ac90f000 r-xp 00000000 fd:01 831720 /usr/lib64/libglobus_gsi_proxy_core.so.0.7.9 7f71ac90f000-7f71acb0e000 ---p 00011000 fd:01 831720 /usr/lib64/libglobus_gsi_proxy_core.so.0.7.9 7f71acb0e000-7f71acb0f000 rw-p 00010000 fd:01 831720 /usr/lib64/libglobus_gsi_proxy_core.so.0.7.9 7f71acb0f000-7f71acb1b000 r-xp 00000000 fd:01 831713 /usr/lib64/libglobus_gsi_sysconfig.so.1.5.9 7f71acb1b000-7f71acd1a000 ---p 0000c000 fd:01 831713 /usr/lib64/libglobus_gsi_sysconfig.so.1.5.9 7f71acd1a000-7f71acd1b000 rw-p 0000b000 fd:01 831713 /usr/lib64/libglobus_gsi_sysconfig.so.1.5.9 7f71acd1b000-7f71acd1c000 ---p 00000000 00:00 0 7f71acd1c000-7f71ad71c000 rw-p 00000000 00:00 0 7f71ad71c000-7f71ad71d000 ---p 00000000 00:00 0 7f71ad71d000-7f71ae11d000 rw-p 00000000 00:00 0 7f71ae11d000-7f71ae120000 r-xp 00000000 fd:01 808204 /usr/lib64/python2.6/lib-dynload/_hashlib.so 7f71ae120000-7f71ae31f000 ---p 00003000 fd:01 808204 /usr/lib64/python2.6/lib-dynload/_hashlib.so 7f71ae31f000-7f71ae321000 rw-p 00002000 fd:01 808204 /usr/lib64/python2.6/lib-dynload/_hashlib.so 7f71ae321000-7f71ae323000 r-xp 00000000 fd:01 793824 /usr/lib64/python2.6/lib-dynload/fcntlmodule.so 7f71ae323000-7f71ae523000 ---p 00002000 fd:01 793824 /usr/lib64/python2.6/lib-dynload/fcntlmodule.so 7f71ae523000-7f71ae525000 rw-p 00002000 fd:01 793824 /usr/lib64/python2.6/lib-dynload/fcntlmodule.so 7f71ae525000-7f71ae529000 r-xp 00000000 fd:01 793840 /usr/lib64/python2.6/lib-dynload/selectmodule.so 7f71ae529000-7f71ae729000 ---p 00004000 fd:01 793840 /usr/lib64/python2.6/lib-dynload/selectmodule.so 7f71ae729000-7f71ae72b000 rw-p 00004000 fd:01 793840 /usr/lib64/python2.6/lib-dynload/selectmodule.so 7f71ae72b000-7f71ae72f000 r-xp 00000000 fd:01 793804 /usr/lib64/python2.6/lib-dynload/_localemodule.so 7f71ae72f000-7f71ae92f000 ---p 00004000 fd:01 793804 /usr/lib64/python2.6/lib-dynload/_localemodule.so 7f71ae92f000-7f71ae930000 rw-p 00004000 fd:01 793804 /usr/lib64/python2.6/lib-dynload/_localemodule.so 7f71ae930000-7f71ae934000 r-xp 00000000 fd:01 808226 /usr/lib64/python2.6/lib-dynload/termios.so 7f71ae934000-7f71aeb34000 ---p 00004000 fd:01 808226 /usr/lib64/python2.6/lib-dynload/termios.so 7f71aeb34000-7f71aeb36000 rw-p 00004000 fd:01 808226 /usr/lib64/python2.6/lib-dynload/termios.so 7f71aeb36000-7f71aeb40000 r-xp 00000000 fd:01 408748 /lib64/libkrb5support.so.0.1 7f71aeb40000-7f71aed3f000 ---p 0000a000 fd:01 408748 /lib64/libkrb5support.so.0.1 7f71aed3f000-7f71aed40000 r--p 00009000 fd:01 408748 /lib64/libkrb5support.so.0.1 7f71aed40000-7f71aed41000 rw-p 0000a000 fd:01 408748 /lib64/libkrb5support.so.0.1 7f71aed41000-7f71aed48000 r-xp 00000000 fd:01 808209 /usr/lib64/python2.6/lib-dynload/_ssl.so 7f71aed48000-7f71aef47000 ---p 00007000 fd:01 808209 /usr/lib64/python2.6/lib-dynload/_ssl.so 7f71aef47000-7f71aef49000 rw-p 00006000 fd:01 808209 /usr/lib64/python2.6/lib-dynload/_ssl.so 7f71aef49000-7f71aef54000 r-xp 00000000 fd:01 808207 /usr/lib64/python2.6/lib-dynload/_socketmodule.so 7f71aef54000-7f71af154000 ---p 0000b000 fd:01 808207 /usr/lib64/python2.6/lib-dynload/_socketmodule.so 7f71af154000-7f71af158000 rw-p 0000b000 fd:01 808207 /usr/lib64/python2.6/lib-dynload/_socketmodule.so 7f71af158000-7f71af164000 r-xp 00000000 fd:01 393246 /lib64/libnss_files-2.12.so 7f71af164000-7f71af364000 ---p 0000c000 fd:01 393246 /lib64/libnss_files-2.12.so 7f71af364000-7f71af365000 r--p 0000c000 fd:01 393246 /lib64/libnss_files-2.12.so 7f71af365000-7f71af366000 rw-p 0000d000 fd:01 393246 /lib64/libnss_files-2.12.so 7f71af366000-7f71af370000 r-xp 00000000 fd:01 393250 /lib64/libnss_nis-2.12.so 7f71af370000-7f71af56f000 ---p 0000a000 fd:01 393250 /lib64/libnss_nis-2.12.so 7f71af56f000-7f71af570000 r--p 00009000 fd:01 393250 /lib64/libnss_nis-2.12.so 7f71af570000-7f71af571000 rw-p 0000a000 fd:01 393250 /lib64/libnss_nis-2.12.so 7f71af571000-7f71af587000 r-xp 00000000 fd:01 408772 /lib64/libnsl-2.12.so 7f71af587000-7f71af786000 ---p 00016000 fd:01 408772 /lib64/libnsl-2.12.so 7f71af786000-7f71af787000 r--p 00015000 fd:01 408772 /lib64/libnsl-2.12.so 7f71af787000-7f71af788000 rw-p 00016000 fd:01 408772 /lib64/libnsl-2.12.so 7f71af788000-7f71af78a000 rw-p 00000000 00:00 0 7f71af78a000-7f71af792000 r-xp 00000000 fd:01 393242 /lib64/libnss_compat-2.12.so 7f71af792000-7f71af991000 ---p 00008000 fd:01 393242 /lib64/libnss_compat-2.12.so 7f71af991000-7f71af992000 r--p 00007000 fd:01 393242 /lib64/libnss_compat-2.12.so 7f71af992000-7f71af993000 rw-p 00008000 fd:01 393242 /lib64/libnss_compat-2.12.so 7f71af993000-7f71af9a3000 r-xp 00000000 fd:01 793821 /usr/lib64/python2.6/lib-dynload/datetime.so 7f71af9a3000-7f71afba3000 ---p 00010000 fd:01 793821 /usr/lib64/python2.6/lib-dynload/datetime.so 7f71afba3000-7f71afba7000 rw-p 00010000 fd:01 793821 /usr/lib64/python2.6/lib-dynload/datetime.so 7f71afba7000-7f71afc2c000 r-xp 00000000 fd:01 947393 /usr/lib64/python2.6/site-packages/classad.so 7f71afc2c000-7f71afe2b000 ---p 00085000 fd:01 947393 /usr/lib64/python2.6/site-packages/classad.so 7f71afe2b000-7f71afe31000 rw-p 00084000 fd:01 947393 /usr/lib64/python2.6/site-packages/classad.so 7f71afe31000-7f71afe32000 rw-p 00000000 00:00 0 7f71afe32000-7f71afe7b000 r-xp 00000000 fd:01 834639 /usr/lib64/libpyclassad2.6_8_6_6.so 7f71afe7b000-7f71b007b000 ---p 00049000 fd:01 834639 /usr/lib64/libpyclassad2.6_8_6_6.so 7f71b007b000-7f71b007e000 rw-p 00049000 fd:01 834639 /usr/lib64/libpyclassad2.6_8_6_6.so 7f71b007e000-7f71b01c6000 r-xp 00000000 fd:01 947394 /usr/lib64/python2.6/site-packages/htcondor.so 7f71b01c6000-7f71b03c6000 ---p 00148000 fd:01 947394 /usr/lib64/python2.6/site-packages/htcondor.so 7f71b03c6000-7f71b03d5000 rw-p 00148000 fd:01 947394 /usr/lib64/python2.6/site-packages/htcondor.so 7f71b03d5000-7f71b03dc000 r-xp 00000000 fd:01 947281 /usr/lib64/python2.6/site-packages/zmq/devices/monitoredqueue.so 7f71b03dc000-7f71b05dc000 ---p 00007000 fd:01 947281 /usr/lib64/python2.6/site-packages/zmq/devices/monitoredqueue.so 7f71b05dc000-7f71b05de000 rw-p 00007000 fd:01 947281 /usr/lib64/python2.6/site-packages/zmq/devices/monitoredqueue.so 7f71b05de000-7f71b05e4000 r-xp 00000000 fd:01 793807 /usr/lib64/python2.6/lib-dynload/_multiprocessing.so 7f71b05e4000-7f71b07e4000 ---p 00006000 fd:01 793807 /usr/lib64/python2.6/lib-dynload/_multiprocessing.so 7f71b07e4000-7f71b07e5000 rw-p 00006000 fd:01 793807 /usr/lib64/python2.6/lib-dynload/_multiprocessing.so 7f71b07e5000-7f71b07e6000 r-xp 00000000 fd:01 808211 /usr/lib64/python2.6/lib-dynload/_weakref.so 7f71b07e6000-7f71b09e6000 ---p 00001000 fd:01 808211 /usr/lib64/python2.6/lib-dynload/_weakref.so 7f71b09e6000-7f71b09e7000 rw-p 00001000 fd:01 808211 /usr/lib64/python2.6/lib-dynload/_weakref.so 7f71b09e7000-7f71b09ed000 r-xp 00000000 fd:01 947260 /usr/lib64/python2.6/site-packages/zmq/backend/cython/_device.so 7f71b09ed000-7f71b0bed000 ---p 00006000 fd:01 947260 /usr/lib64/python2.6/site-packages/zmq/backend/cython/_device.so 7f71b0bed000-7f71b0bee000 rw-p 00006000 fd:01 947260 /usr/lib64/python2.6/site-packages/zmq/backend/cython/_device.so 7f71b0bee000-7f71b0bf1000 r-xp 00000000 fd:01 947262 /usr/lib64/python2.6/site-packages/zmq/backend/cython/_version.so 7f71b0bf1000-7f71b0df0000 ---p 00003000 fd:01 947262 /usr/lib64/python2.6/site-packages/zmq/backend/cython/_version.so 7f71b0df0000-7f71b0df1000 rw-p 00002000 fd:01 947262 /usr/lib64/python2.6/site-packages/zmq/backend/cython/_version.so 7f71b0df1000-7f71b0df9000 r-xp 00000000 fd:01 947261 /usr/lib64/python2.6/site-packages/zmq/backend/cython/_poll.so 7f71b0df9000-7f71b0ff8000 ---p 00008000 fd:01 947261 /usr/lib64/python2.6/site-packages/zmq/backend/cython/_poll.so 7f71b0ff8000-7f71b0ffa000 rw-p 00007000 fd:01 947261 /usr/lib64/python2.6/site-packages/zmq/backend/cython/_poll.so 7f71b0ffa000-7f71b0fff000 r-xp 00000000 fd:01 947274 /usr/lib64/python2.6/site-packages/zmq/backend/cython/utils.so 7f71b0fff000-7f71b11ff000 ---p 00005000 fd:01 947274 /usr/lib64/python2.6/site-packages/zmq/backend/cython/utils.so 7f71b11ff000-7f71b1200000 rw-p 00005000 fd:01 947274 /usr/lib64/python2.6/site-packages/zmq/backend/cython/utils.so 7f71b1200000-7f71b1207000 r-xp 00000000 fd:01 919897 /usr/lib64/python2.6/site-packages/simplejson/_speedups.so 7f71b1207000-7f71b1407000 ---p 00007000 fd:01 919897 /usr/lib64/python2.6/site-packages/simplejson/_speedups.so 7f71b1407000-7f71b1408000 rw-p 00007000 fd:01 919897 /usr/lib64/python2.6/site-packages/simplejson/_speedups.so 7f71b1408000-7f71b140f000 r-xp 00000000 fd:01 808210 /usr/lib64/python2.6/lib-dynload/_struct.so 7f71b140f000-7f71b160f000 ---p 00007000 fd:01 808210 /usr/lib64/python2.6/lib-dynload/_struct.so 7f71b160f000-7f71b1611000 rw-p 00007000 fd:01 808210 /usr/lib64/python2.6/lib-dynload/_struct.so 7f71b1611000-7f71b1614000 r-xp 00000000 fd:01 793808 /usr/lib64/python2.6/lib-dynload/_randommodule.so 7f71b1614000-7f71b1813000 ---p 00003000 fd:01 793808 /usr/lib64/python2.6/lib-dynload/_randommodule.so 7f71b1813000-7f71b1814000 rw-p 00002000 fd:01 793808 /usr/lib64/python2.6/lib-dynload/_randommodule.so 7f71b1814000-7f71b1818000 r-xp 00000000 fd:01 793816 /usr/lib64/python2.6/lib-dynload/binascii.so 7f71b1818000-7f71b1a18000 ---p 00004000 fd:01 793816 /usr/lib64/python2.6/lib-dynload/binascii.so 7f71b1a18000-7f71b1a19000 rw-p 00004000 fd:01 793816 /usr/lib64/python2.6/lib-dynload/binascii.so 7f71b1a19000-7f71b1a1e000 r-xp 00000000 fd:01 793831 /usr/lib64/python2.6/lib-dynload/mathmodule.so 7f71b1a1e000-7f71b1c1d000 ---p 00005000 fd:01 793831 /usr/lib64/python2.6/lib-dynload/mathmodule.so 7f71b1c1d000-7f71b1c1f000 rw-p 00004000 fd:01 793831 /usr/lib64/python2.6/lib-dynload/mathmodule.so 7f71b1c1f000-7f71b1c32000 r-xp 00000000 fd:01 947272 /usr/lib64/python2.6/site-packages/zmq/backend/cython/socket.so 7f71b1c32000-7f71b1e32000 ---p 00013000 fd:01 947272 /usr/lib64/python2.6/site-packages/zmq/backend/cython/socket.so 7f71b1e32000-7f71b1e36000 rw-p 00013000 fd:01 947272 /usr/lib64/python2.6/site-packages/zmq/backend/cython/socket.so 7f71b1e36000-7f71b1e3e000 r-xp 00000000 fd:01 947266 /usr/lib64/python2.6/site-packages/zmq/backend/cython/context.so 7f71b1e3e000-7f71b203e000 ---p 00008000 fd:01 947266 /usr/lib64/python2.6/site-packages/zmq/backend/cython/context.so 7f71b203e000-7f71b2040000 rw-p 00008000 fd:01 947266 /usr/lib64/python2.6/site-packages/zmq/backend/cython/context.so 7f71b2040000-7f71b204c000 r-xp 00000000 fd:01 947270 /usr/lib64/python2.6/site-packages/zmq/backend/cython/message.so 7f71b204c000-7f71b224c000 ---p 0000c000 fd:01 947270 /usr/lib64/python2.6/site-packages/zmq/backend/cython/message.so 7f71b224c000-7f71b224e000 rw-p 0000c000 fd:01 947270 /usr/lib64/python2.6/site-packages/zmq/backend/cython/message.so 7f71b224e000-7f71b2251000 r-xp 00000000 fd:01 947267 /usr/lib64/python2.6/site-packages/zmq/backend/cython/error.so 7f71b2251000-7f71b2451000 ---p 00003000 fd:01 947267 /usr/lib64/python2.6/site-packages/zmq/backend/cython/error.so 7f71b2451000-7f71b2452000 rw-p 00003000 fd:01 947267 /usr/lib64/python2.6/site-packages/zmq/backend/cython/error.so 7f71b2452000-7f71b2499000 r-xp 00000000 fd:01 791821 /usr/lib64/libpgm-5.1.so.0.0.118 7f71b2499000-7f71b2699000 ---p 00047000 fd:01 791821 /usr/lib64/libpgm-5.1.so.0.0.118 7f71b2699000-7f71b269a000 rw-p 00047000 fd:01 791821 /usr/lib64/libpgm-5.1.so.0.0.118 7f71b269a000-7f71b269e000 rw-p 00000000 00:00 0 7f71b269e000-7f71b26e6000 r-xp 00000000 fd:01 792924 /usr/lib64/libzmq.so.3.0.0 7f71b26e6000-7f71b28e6000 ---p 00048000 fd:01 792924 /usr/lib64/libzmq.so.3.0.0 7f71b28e6000-7f71b28eb000 rw-p 00048000 fd:01 792924 /usr/lib64/libzmq.so.3.0.0 7f71b28eb000-7f71b28f4000 r-xp 00000000 fd:01 947264 /usr/lib64/python2.6/site-packages/zmq/backend/cython/constants.so 7f71b28f4000-7f71b2af3000 ---p 00009000 fd:01 947264 /usr/lib64/python2.6/site-packages/zmq/backend/cython/constants.so 7f71b2af3000-7f71b2af6000 rw-p 00008000 fd:01 947264 /usr/lib64/python2.6/site-packages/zmq/backend/cython/constants.so 7f71b2af6000-7f71b2afa000 r-xp 00000000 fd:01 808216 /usr/lib64/python2.6/lib-dynload/cStringIO.so 7f71b2afa000-7f71b2cf9000 ---p 00004000 fd:01 808216 /usr/lib64/python2.6/lib-dynload/cStringIO.so 7f71b2cf9000-7f71b2cfb000 rw-p 00003000 fd:01 808216 /usr/lib64/python2.6/lib-dynload/cStringIO.so 7f71b2cfb000-7f71b2d0c000 r-xp 00000000 fd:01 808215 /usr/lib64/python2.6/lib-dynload/cPickle.so 7f71b2d0c000-7f71b2f0c000 ---p 00011000 fd:01 808215 /usr/lib64/python2.6/lib-dynload/cPickle.so 7f71b2f0c000-7f71b2f0d000 rw-p 00011000 fd:01 808215 /usr/lib64/python2.6/lib-dynload/cPickle.so 7f71b2f0d000-7f71b2f0e000 rw-p 00000000 00:00 0 7f71b2f0e000-7f71b2f13000 r-xp 00000000 fd:01 793842 /usr/lib64/python2.6/lib-dynload/stropmodule.so 7f71b2f13000-7f71b3112000 ---p 00005000 fd:01 793842 /usr/lib64/python2.6/lib-dynload/stropmodule.so 7f71b3112000-7f71b3114000 rw-p 00004000 fd:01 793842 /usr/lib64/python2.6/lib-dynload/stropmodule.so 7f71b3114000-7f71b311d000 r-xp 00000000 fd:01 793829 /usr/lib64/python2.6/lib-dynload/itertoolsmodule.so 7f71b311d000-7f71b331d000 ---p 00009000 fd:01 793829 /usr/lib64/python2.6/lib-dynload/itertoolsmodule.so 7f71b331d000-7f71b3321000 rw-p 00009000 fd:01 793829 /usr/lib64/python2.6/lib-dynload/itertoolsmodule.so 7f71b3321000-7f71b3329000 r-xp 00000000 fd:01 793834 /usr/lib64/python2.6/lib-dynload/operator.so 7f71b3329000-7f71b3528000 ---p 00008000 fd:01 793834 /usr/lib64/python2.6/lib-dynload/operator.so 7f71b3528000-7f71b352a000 rw-p 00007000 fd:01 793834 /usr/lib64/python2.6/lib-dynload/operator.so 7f71b352a000-7f71b3530000 r-xp 00000000 fd:01 793791 /usr/lib64/python2.6/lib-dynload/_collectionsmodule.so 7f71b3530000-7f71b372f000 ---p 00006000 fd:01 793791 /usr/lib64/python2.6/lib-dynload/_collectionsmodule.so 7f71b372f000-7f71b3731000 rw-p 00005000 fd:01 793791 /usr/lib64/python2.6/lib-dynload/_collectionsmodule.so 7f71b3731000-7f71b3734000 r-xp 00000000 fd:01 808227 /usr/lib64/python2.6/lib-dynload/timemodule.so 7f71b3734000-7f71b3934000 ---p 00003000 fd:01 808227 /usr/lib64/python2.6/lib-dynload/timemodule.so 7f71b3934000-7f71b3936000 rw-p 00003000 fd:01 808227 /usr/lib64/python2.6/lib-dynload/timemodule.so 7f71b3936000-7f71b3938000 r-xp 00000000 fd:01 793799 /usr/lib64/python2.6/lib-dynload/_functoolsmodule.so 7f71b3938000-7f71b3b38000 ---p 00002000 fd:01 793799 /usr/lib64/python2.6/lib-dynload/_functoolsmodule.so 7f71b3b38000-7f71b3b39000 rw-p 00002000 fd:01 793799 /usr/lib64/python2.6/lib-dynload/_functoolsmodule.so 7f71b3b39000-7f71b3b7a000 rw-p 00000000 00:00 0 7f71b3b7c000-7f71b3c7e000 rw-p 00000000 00:00 0 7f71b3c7e000-7f71b9b0f000 r--p 00000000 fd:01 787693 /usr/lib/locale/locale-archive 7f71b9b0f000-7f71b9b50000 rw-p 00000000 00:00 0 7f71b9b82000-7f71b9c09000 rw-p 00000000 00:00 0 7f71b9c27000-7f71b9c2b000 rw-p 00000000 00:00 0 7ffe35e2a000-7ffe35e51000 rw-p 00000000 00:00 0 [stack] 7ffe35f26000-7ffe35f27000 r-xp 00000000 00:00 0 [vdso] ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall] Aborted (core dumped) I read the htcondor code for python bindings and I understand that it is essentially use boost python for the bindings. I highly suspect that the htcondor python bindings do not handle memory properly and corrupt
the python if they run for a long time. But I do not have any guess regarding to what is leading to the problem.
|