ASET Colloquium

Advancing Throughput Computing for the Physical Sciences

by Prof. Miron Livny (University of Wisconsin-Madison and Morgridge Institute of Research)

Friday, September 6, 2024 from to (Asia/Kolkata)
at Hybrid ( https://zoom.us/j/91427966752 )
AG66, TIFR Mumbai.
Description
Abstract: 
The Center for High Throughput Computing (CHTC) is the home of the widely adopted HTCondor Software Suite (HTCSS) and the recently launched Pelican Platform. Spanning the Compute, Information and Data School (CIDS) and the Morgridge Institute for Research on the Madison campus, the center was established more than 15 years ago on the foundation of a research methodology that brings together innovation in distributed computing, dependable services to scientists and community building. Working closely with engaged communities of users to adopt and evaluate under real-life conditions new distributed computing technologies, the center advanced scientific discovery across a broad range of disciplines and maintained a user guided research and development agenda. 

What started in the early 90's with the deployment of a Condor system at the National Institute for Subatomic Physics (Nikhef) in Amsterdam, has evolved over the past 3 decade to an adoption of the HTCSS to place effective computing capabilities in the hands of researchers with workloads that can benefit from advances in Throughput Computing. Today, the Worldwide LHC Grid (WLCG) Tier 0 in Geneva (CERN) and most of the Tier 1 sites around the world have adopted HTCSS to manage their local throughput computing capacity. What started as a HEP focused collaboration has evolved into adoption of HTCSS and Pelican by a growing number of science collaborations. These include the International Gravitational Wave (IGWN) community and the IceCube Neutrino Observatory. In a recent run, HTCSS and Pelican enabled the National Radio Astronomy (NRAO) in the US to deliver one of the deepest radio images of space by processing a decade old dataset. 

The talk will present the different methodologies and elements that underpin the translational work of the CHTC. As a growing number of science domains depend on computational workloads that consist of an ever-growing number of self-contained tasks, CHTC is actively engaged in bringing the decades long experiences to these domains. The center offers a fabric of services that include a campus wide and a national “open capacity” computing environment as well as a sustained sequence of software releases. The recent addition of the Pelican Platform to the CHTC research and development portfolio brings storage management and data delivery foci to the center. The opportunities for innovation triggered by an ever-evolving research computing landscape at different scales will be reviewed. 

Profile: 
Miron Livny is a senior researcher and the John P. Morgridge Professor of Computer Science, specializing in distributed computing at the University of Wisconsin–Madison, Principal Scientist at Core Computational Technology of the Wisconsin Institutes for Discovery, Chief Technology Officer of the Wisconsin Institutes for Discovery, founding Director of the UW Center for High Throughput Computing (CHTC), Director of the Software Assurance Marketplace and the Technical Director of the Open Science Grid (OSG). 

His early research established an understanding of how scientific discovery can be advanced by communities of autonomous, networked computers. Livny pioneered methodologies of high-throughput computing and built the widely adopted HTCondor Software Suite, which facilitates the management and sharing of (often huge assemblages of) data through computing tasks handled by distributed computing resources. 

His research interests include: Distributed Processing Systems, High Throughput Computing, Software Assurance, Cyberinfrastructure 

https://youtu.be/Til_DPx3VA4
Material:
Organised by ASET