[HTCondor-users] Monitoring and Administration

[Renaud Guezennec <renaud@xxxxxxx>]

Hi,

To be honest, I'm in charge of making monitoring software but a previous 
software engineer made a proof of concept in Qt/python, I'm studying his 
work. He used e-tree as XML parser. The software displays current user's 
jobs, and some status for each cluster. The python program starts 
commands as condor_q -xml -attributes "........" and it parses output. 
It is working but it displays only job from the current user, I'm trying 
to display all jobs instead.

We are thinking about switching to Qt/C++, We will probably use the same 
mechanism, parsing condor_q stdout. But If there is another way, I'm 
interested to know more. Our goal is to provide Qt application such as 
Qube! or Deadline. We want to know job status, job progression for our 
artists, managers want ability to change priority of job or several jobs.
Priorities are managed by projects in my company. When new projects 
start, we have to amend a bit the HTCondor configuration.
If we forget to do so, the jobs of this new project have no priority so 
they don't start.

I have some questions:
-Can we modify the configuration on the fly, by sending command instead 
of changing configuration file ?  I understood it is possible to ask to 
the server(master) to read its configuration, am I wrong ?
-Is there a way to get job's progression ?
-The Python program asks data regularly, is there another way ? Get 
notifications ?




Renaud






On 12/11/2013 06:10 PM, Brian Bockelman wrote:
> Hi Renaud,
>
> I've also recently noticed there are a few issues along these lines.  Examples:
>
> $ condor_q -xml -stream
> </classads>
>
> or
>
> $ condor_q -global -xml
> All queues are empty
>
> You don't happen to be writing this in python, are you?  Locally, we've ditched trying to parse condor_q stdout and use the native bindings.
>
> Another approach is to use:
>
> condor_status -schedd -af Name
>
> to get the list of schedds, then loop over each of these.
>
> Brian
>
> On Dec 11, 2013, at 10:52 AM, Renaud Guezennec<renaud@xxxxxxx>  wrote:
>
> > Hi all,
> >
> > I'm new in HTCondor community. I'm working on monitoring and administration software to watch HTCondor jobs and pools in my company.
> >
> > I tried to use "condor_q -global -xml" but the output it is not a well-shaped xml file. Xml parsers run to errors when trying build the tree.
> > When I ask for 'condor_q -xml", this output is  a proper XML.
> >
> >
> > condor_q -version
> > $CondorVersion: 7.8.5 Oct 09 2012 BuildID: 68720 $
> > $CondorPlatform: x86_64_deb_6.0 $
> >
> >
> >
> >
> > Regards
> > Renaud
> > _______________________________________________
> > HTCondor-users mailing list
> > To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> > subject: Unsubscribe
> > You can also unsubscribe by visiting
> > https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
> >
> > The archives can be found at:
> > https://lists.cs.wisc.edu/archive/htcondor-users/
>
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/