Re: [HTCondor-users] Building HTCondor with BLAHP support

["Koschmieder, Lukas Michael" <Lukas.Koschmieder@xxxxxxxxxxxxxx>]

Hi Ido,

Thank you, this was very helpful. But unfortunately now I've got another problem. The build system fails to compile boost 1.66. This is the error message:

 make[3]: Entering directory '/home/lukask/access_cl02/htcondor-8_9_3-build'
 [  1%] Performing build step for 'boost'
 Performing configuration checks

 (...)

 gcc.compile.c++ bin.v2/libs/python/build/gcc-gnu-4.8/release/link-static/threadapi-pthread/threading-multi/list.o
 In file included from ./boost/python/detail/prefix.hpp:13:0,
   from ./boost/python/list.hpp:8,
   from libs/python/src/list.cpp:5:
 ./boost/python/detail/wrap_python.hpp:75:24: fatal error: patchlevel.h: No such file or directory
 #include <patchlevel.h>
    ^
 compilation terminated.

 (...)

 externals/bundles/boost/1.66.0/CMakeFiles/boost.dir/build.make:113: recipe for target 'externals/bundles/boost/1.66.0/boost-prefix/src/boost-stamp/boost-build' failed
 make[3]: *** [externals/bundles/boost/1.66.0/boost-prefix/src/boost-stamp/boost-build] Error 1
 make[3]: Leaving directory '/home/lukask/access_cl02/htcondor-8_9_3-build'
 CMakeFiles/Makefile2:1156: recipe for target 'externals/bundles/boost/1.66.0/CMakeFiles/boost.dir/all' failed
 make[2]: *** [externals/bundles/boost/1.66.0/CMakeFiles/boost.dir/all] Error 2
 make[2]: Leaving directory '/home/lukask/access_cl02/htcondor-8_9_3-build'
 Makefile:160: recipe for target 'all' failed
 make[1]: *** [all] Error 2
 make[1]: Leaving directory '/home/lukask/access_cl02/htcondor-8_9_3-build'
 Makefile:101: recipe for target 'htcondor-8_9_3-release' failed
 make: *** [htcondor-8_9_3-release] Error 2

I've managed to compile boost 1.66 from source though. Is there maybe a way to tell the build system to build everything the "UW way" except for boost? I've already tried to set the corresponding environment variables but this doesn't seem to have any effect at all. 

 BoostDir:=$(PWD)/boost_1_66_0/install/
 export CONDOR_EXTERNAL_LINK_DIRS:=$(BoostDir)/lib
 export LIBRARY_PATH:=$(BoostDir)/lib/
 export LD_LIBRARY_PATH:=$(BoostDir)/lib/
 export CMAKE_SYSTEM_LIBRARY_PATH:=$(BoostDir)/lib/
 export CMAKE_INCLUDE_PATH:=$(BoostDir)/include/
 export CPATH:=$(BoostDir)/include/

Judging by the CMake output, the build system won't attempt to detect system libraries when running in "UW_BUILD mode".

 cd htcondor-8_9_3-build && \
 make -j 1   && \
 make -j 1 install
 make[1]: Entering directory '/home/lukask/access_cl02/htcondor-8_9_3-build'
 make[2]: Entering directory '/home/lukask/access_cl02/htcondor-8_9_3-build'
 make[3]: Entering directory '/home/lukask/access_cl02/htcondor-8_9_3-build'
 make[3]: Leaving directory '/home/lukask/access_cl02/htcondor-8_9_3-build'
 [  1%] Built target drmaa
 make[3]: Entering directory '/home/lukask/access_cl02/htcondor-8_9_3-build'
 make[3]: Leaving directory '/home/lukask/access_cl02/htcondor-8_9_3-build'
 make[3]: Entering directory '/home/lukask/access_cl02/htcondor-8_9_3-build'
 [  1%] Performing build step for 'boost'
 Performing configuration checks

 (...)

Do you have any ideas on how to proceed?

Lukas

---

From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Ido Shamay <idoshamay@xxxxxxxxx>
Sent: Thursday, February 27, 2020 8:15:19 PM
To: HTCondor-Users Mail List
Subject: Re: [HTCondor-users] Building HTCondor with BLAHP support

 

Hi Lukas,

I'm by no means an expert on this, by had the chance to build it from source, with few different configurations, few times in the past.

The answer mostly Based on https://htcondor-wiki.cs.wisc.edu/index.cgi/wiki?p=BuildingHtcondorOnLinux and looking at the CMake code.

If you go the "UW way" (configure_uw or -DUW_BUILD:BOOL=TRUE) then the build system will fetch a specific version, patch it, build it and statistically link to the project.

In this case, it takes it from http://parrot.cs.wisc.edu/externals/blahp-1.16.5.1.tar.gz 

If you use "Proper way" then you install it on your own on the machine.

That flow is similar for almost all external dependencies.

I hope it helps.

Ido

On Thu, Feb 27, 2020 at 8:43 PM Koschmieder, Lukas Michael <Lukas.Koschmieder@xxxxxxxxxxxxxx> wrote:

Hi,

I would like to build HTCondor from source with BLAHP support. But there is no WANT_BLAHP option as far as I can tell. Are you supposed to build BLAHP independently and include it using WITH_BLAHP? If yes, where would I find the BLAHP source code?

Cheers,

Lukas

--
Lukas Koschmieder
ACCESS
RWTH Aachen University
Intzestraße 5
52072 Aachen
Germany

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

--

Ido