[Condor-users] Condor Pool History

["C. J. Barker" <cbarker@xxxxxxxxxxxxxxx>]

Hello Folks,

I am trying to centralize the Condor pool's history files on our central
manager.  I have configured the manager's condor_config.local file with
the following:

KEEP_POOL_HISTORY = true                   
POOL_HISTORY_DIR = /usr/share/condor/local.tejas/pool_history

This configuration was activated last Friday.  The central manager has
just started creating history files today, April 12.  In addition there
are numerous "old" and "new" files.  It's not quite clear to me how this
works.  I imagine the delay is due to the central manager aggregating
and collecting the history files from submission machines.  

At the end of the day will these files be merged, or are these periodic
snapshots of history logs?

[root@tejas pool_history]# ls -l
total 2464
-rw-r--r--    1 condor   condor     330316 Apr 12 17:23 viewhist0.0.new
-rw-r--r--    1 condor   condor      90474 Apr 12 17:15 viewhist0.1.new
-rw-r--r--    1 condor   condor      25806 Apr 12 17:15 viewhist0.2.new
-rw-r--r--    1 condor   condor      60233 Apr 12 17:23 viewhist1.0.new
-rw-r--r--    1 condor   condor     338066 Apr 12 16:35 viewhist1.0.old
-rw-r--r--    1 condor   condor     267903 Apr 12 17:15 viewhist1.1.new
-rw-r--r--    1 condor   condor     333341 Apr 12 02:35 viewhist1.1.old
-rw-r--r--    1 condor   condor      68529 Apr 12 17:15 viewhist1.2.new
-rw-r--r--    1 condor   condor     336042 Apr 12 02:19 viewhist1.2.old
-rw-r--r--    1 condor   condor     249652 Apr 12 17:23 viewhist2.0.new
-rw-r--r--    1 condor   condor      62327 Apr 12 17:15 viewhist2.1.new
-rw-r--r--    1 condor   condor      15581 Apr 12 17:15 viewhist2.2.new
-rw-r--r--    1 condor   condor     197811 Apr 12 17:23 viewhist3.0.new
-rw-r--r--    1 condor   condor      52907 Apr 12 17:15 viewhist3.1.new
-rw-r--r--    1 condor   condor      14907 Apr 12 17:15 viewhist3.2.new
-rw-r--r--    1 condor   condor          0 Apr  8 21:35 viewhist4.0.new
-rw-r--r--    1 condor   condor          0 Apr  8 21:47 viewhist4.1.new
-rw-r--r--    1 condor   condor          0 Apr  8 22:35 viewhist4.2.new

Secondly, is the pool_history file data format supposed to be just like
that of the local submission machine's history file?  The pool history
file only is showing basic submission info about job submissions.

1112996113      xlhuang@xxxxxxxxxxxxx/bajie.cs.utexas.edu       :
0       2

I'd like to be able to access detailed information such that is
contained in a submit machine's history file, but have all this
information centrally located in the condor pool history files.  Is this
possible, or is the pool history used mainly for basic info in "Condor
View"?

Thanks and sorry for such a long message,
- C. J.


--------------------------------
C. J. Barker
Distributed & Grid Computing
Texas Advanced Computing Center
http://www.tacc.utexas.edu
512.471.5809
--------------------------------