Re: Invitation to CHTC Workflow Tools Workshop

[chtc-users@xxxxxxxxxxx]

Hi All,

A friendly (and final) reminder to register for this Friday's Workflow Tools Workshop (by EOB, tomorrow/Thursday), if you haven't already. There are still a few seats left!

We've got the Orchard View room (3280) reserved in the Discovery building and will email registered attendees with a reminder of logistical details shortly before the workshop.

'See you Friday!

CHTC

On Mon, Feb 11, 2019 at 4:39 PM <chtc-users@xxxxxxxxxxx> wrote:

Greetings CHTC Users,

We are excited to announce a Workflow Tools Workshop on Friday, February 22, from 1-4:30pmÂ(full details here) featuring conceptual overviews and some hands-on examples. CHTC staff will introduce the workshop, with training delivered in collaboration with CHTC's long-time HTC partners from the Cooperative Computing Lab at the University of Notre-Dame, who develop the Makeflow and Work Queue tools for workflow execution. These tools are especially useful for job batches with widely varying memory and disk requirements or varying job durations, and workflows with many separate job steps, among other advantages (descriptions below).

Those interested in attending are asked toÂREGISTER FOR THE WORKSHOP, so that we can make sure to have enough seats. You are welcome to bring a laptop if you would like to participate in the hands-one examples (will also need an active CHTC account on our HTC System), though doing so is not a requirement.

Feel free to distribute widely to other UW-Madison researchers who may be interested, and send any questions to chtc@xxxxxxxxxxx. We hope to see you there!

Workshop ScheduleÂ(portions may shift slightly, but within 1-4:30pm)

1:00-1:20pm Workflow Types and Tools

1:20-2:00pm ÂMakeflow Conceptual Intro and Tutorial/Demo

2:00-2:30pm ÂWorkQueue Conceptual Intro

------<BREAK>------

2:45-3:30pm WorkQueue Tutorial/Demo

3:45-4:20pm UW-Madison Examples and Group Discussion

4:30pm - ONÂ Informal discussion at The Sett

Makeflow is a portable workflow manager in which tasks to be executed are described in terms of input and output files in a technology-neutral way. Makeflow automatically figures out which tasks in the workflow depend on each other, which tasks can be executed in parallel, and appropriately executes them in a variety of compute scheduling systems, including HTCondor, Slurm, Amazon EC2 and the bundled Work Queue system.

Work Queue is a framework for building large master-worker applications that span thousands of machines drawn from clusters, clouds, and grids. Work Queue applications are written in C, Python, or Perl using a simple API that allows users to define tasks, submit them to the queue, and wait for completion. Tasks are executed by a standard worker process that can run on any available machine. Each worker calls home to the master process, arranges for data transfer, and executes the tasks.

Cheers,

Your CHTC Team

_______________________________________________
CHTC-users mailing list
CHTC-users@xxxxxxxxxxx
To unsubscribe send an email to:
chtc@xxxxxxxxxxx
https://lists.cs.wisc.edu/mailman/listinfo/chtc-users