Re: [HTCondor-devel] [htcondor-staff] Of interest - Mesos

[Matthew Farrellee <matt@xxxxxxxxxxx>]

On 11/23/2012 01:36 PM, Todd Tannenbaum wrote:
> Just FYI, I found the following of interest:
>
> http://www.mesosproject.org/
>
> Apache Mesos is a cluster manager to provide resource isolation and
> sharing across distributed frameworks.  E.g. effectively run HTCondor,
> PBS, Hadoop, Spark, etc, on the same cluster hardware. Uses LXC (linux
> containers).
Likewise, Corona from Facebook -

https://www.facebook.com/notes/facebook-engineering/under-the-hood-scheduling-mapreduce-jobs-more-efficiently-with-corona/10151142560538920

And of course YARN -

http://hadoop.apache.org/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/YARN.html

This space just keeps growing with clear pain points around application 
integration and workload consolidation.
Best,


matt