High Throughput Computing in the Service of Scientific Discovery

For about three decades, we have been engaged in translating the potential of distributed computing into effective High Throughput Computing (HTC) software tools. The HTCondor distributed resource and job management system that we developed has facilitated evaluation of novel HTC frameworks and technologies under real-life workloads. Our work led to close collaboration with researchers and contributed to two Nobel prizes in recent years. The UW-Madison Center for High Throughput Computing delivered about 400M core hours to more than 250 projects during last year. While about 30% of these hours were consumed by the Compact Muon Solenoid (CMS) experiment, about 13% were used by the IceCube Neutrino collaboration. This talk will present the principles that have been guiding our work and review our experience in deploying HTCondor in different research computing settings. 

About the Speaker:

Miron Livny received B.Sc. from the Hebrew University and M.Sc. and Ph.D. degrees from the Weizmann Institute of Science. Since 1983 he has been a faculty at the Computer Sciences Department, University of Wisconsin-Madison, where he is currently the John P. Morgridge Professor of Computer Science, the director of the Center for High Throughput Computing (CHTC), the principal investigator and technical director of the Open Science Grid (OSG) and is leading the HTCondor project. He is leading the SWAMP project at the Morgridge Institute of Research and is also the Chief Technology Officer of the Wisconsin Institutes of Discovery.