论文标题

高级Python性能监视,分数-P

Advanced Python Performance Monitoring with Score-P

论文作者

Gocht, Andreas, Schöne, Robert, Frenzel, Jan

论文摘要

在过去的几年中,Python在科学界变得更加突出,现在用于模拟,机器学习和数据分析。所有这些任务从并行性和卸载提供的其他计算功率中获利。在高性能计算的领域(HPC)中,我们可以回顾几十年的经验,这些经验利用了核心,节点或节点级别上不同级别的并行性,以及使用加速器。通过使用绩效分析工具来研究所有这些并行性级别,我们可以调整应用程序以进行前所未有的性能。不幸的是,标准的Python性能分析工具无法应对高度平行的程序。由于此类软件的开发是复杂且容易出错的,因此我们演示了基于现有工具基础架构进行性能分析的易于使用的解决方案。在本文中,我们描述了如何应用已建立的仪器框架\ Scorep来追踪Python应用程序。我们完成了对用户可以期望启动其应用程序的间接费用的研究。

Within the last years, Python became more prominent in the scientific community and is now used for simulations, machine learning, and data analysis. All these tasks profit from additional compute power offered by parallelism and offloading. In the domain of High Performance Computing (HPC), we can look back to decades of experience exploiting different levels of parallelism on the core, node or inter-node level, as well as utilising accelerators. By using performance analysis tools to investigate all these levels of parallelism, we can tune applications for unprecedented performance. Unfortunately, standard Python performance analysis tools cannot cope with highly parallel programs. Since the development of such software is complex and error-prone, we demonstrate an easy-to-use solution based on an existing tool infrastructure for performance analysis. In this paper, we describe how to apply the established instrumentation framework \scorep to trace Python applications. We finish with a study of the overhead that users can expect for instrumenting their applications.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源