Re: [HTCondor-users] HTCondor logs in an ELK stack

[Christopher Harrison <harrison@xxxxxxxxxxxxxxxx>]

I am currently working on a system/application profiling solution which i am using internally for collecting data for a separate project.   Additionally, I have had good luck with direct adding the classad's directly into mongodb via json import and condor_history -json exporting.   I would be happy to folllow-up more offline.

    -C

On 4/29/19 2:31 PM, Beyer, Christoph wrote:

Hi Mary,

there is a hepix working group dedicated to batch monitoring, I am not following closely but I think it would be beneficial for you to join:

>
> hepix-batchmonitoring-wg mailing list
> hepix-batchmonitoring-wg@xxxxxxxxx
> http://listserv.in2p3.fr/archives/hepix-batchmonitoring-wg.html
> To unsubscribe from the hepix-batchmonitoring-wg list, click the following link:
> https://listserv.in2p3.fr/cgi-bin/wa?SUBED1=hepix-batchmonitoring-wg&A=1

best

Christoph

--
Christoph Beyer
DESY Hamburg
IT-Department

Notkestr. 85
Building 02b, Room 009
22607 Hamburg

phone:+49-(0)40-8998-2317
mail: christoph.beyer@xxxxxxx

---

Von: "Mary Romelfanger" <mary@xxxxxxxxx>
An: "htcondor-users" <htcondor-users@xxxxxxxxxxx>
Gesendet: Montag, 29. April 2019 20:38:06
Betreff: [HTCondor-users] HTCondor logs in an ELK stack

 

 

Hi Everyone,

 

I am about lose my HTCondor monitoring system and I have to find a new one.   At the same time we are moving other logs and system monitoring into a Kibana/ELK environment, so the time has come for me to explore HTCondor monitoring within an ELK stack.

 

A little searching lead me a presentation by William Deck at HTCondor Week 2017 that looks like his organization has already done a lot of work in this environment.   I hoping that Mr. Deck is a member of this list and that I can get an e-mail from him, so that we can learn from and perhaps borrow from your knowledge.  

 

At the same time, I was wondering if any other groups have spent any time working with the HTCondor logs in Kibana?

 

         Thank You â Mary

 

 

Mary Romelfanger

Deputy Branch Manager/

Principal Computer Scientist

Data Systems Branch

.___.      

{o,o}      Phone 410-338-6708
/)__)     Cell      443-244-0191
-"-"-          mary@xxxxxxxxx

 

Space Telescope Science Institute

3700 San Martin Drive

Baltimore, MD 21218

 

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

-- 


Christopher Harrison
Systems Engineer
Department of Biostatistics & Medical Informatics
University of Wisconsin School of Medicine and Public Health
J4/503 CSC, Box 4675
600 Highland Avenue
Madison, WI 53792-4675
608.3476.6967