HotCloudPerf 2018 - First Workshop on Hot Topics in Cloud Computing Performance

Cloud computing is emerging as one of the most profound changes in the way we build and use IT. The use of global services in public clouds is increasing, and the lucrative and rapidly growing global cloud market already supports over 1 million IT-related jobs. However, it is currently challenging to make the IT services offered by public and private clouds performant (in an extended sense) and efficient. Emerging architectures, techniques, and real-world systems include hybrid deployment, serverless operation, everything as a service, complex workflows, auto-scaling and -tiering, etc. It is unclear to which extent traditional performance engineering, software engineering, and system design and analysis tools can help with understanding and engineering these emerging technologies. The community also needs practical tools and powerful methods to address hot topics in cloud computing performance.
Responding to this need, the HotCloudPerf workshop proposes a meeting venue for academics and practitioners, from experts to trainees, in the field of cloud computing performance. The workshop aims to engage this community, and to lead to the development of new methodological aspects for gaining deeper understanding not only of cloud performance, but also of cloud operation and behavior, through diverse quantitative evaluation tools, including benchmarks, metrics, and workload generators. The workshop focuses on novel cloud properties such as elasticity, performance isolation, dependability, and other non-functional system properties, in addition to classical performance-related metrics such as response time, throughput, scalability, and efficiency.
Each year, the workshop chooses a focus theme to explore; for 2018, the theme is “Performance in the cloud datacenter.” Articles focusing on this topic are particularly encouraged for HotCloudPerf-2018.
The HotCloudPerf workshop is technically sponsored by the Standard Performance Evaluation Corporation (SPEC)’s Research Group (RG), and is organized annually by the RG Cloud Group. HotCloudPerf has emerged from the series of yearly meetings organized by the RG Cloud Group in conjunction with ICPE, since 2013. The RG Cloud Group group is taking a broad approach, relevant for both academia and industry, to cloud benchmarking, quantitative evaluation, and experimental analysis.
WORKSHOP SCOPE AND TOPICS
Topics of the focus-theme for 2018, “Performance in the cloud datacenter”:
Serverless computing platforms and micro-services in cloud datacenters.
Understanding and engineering dependability and non-traditional performance requirements for cloud datacenters.
Running specialized services with performance guarantees, such as, Business Process as a Service, Data as a Service, business-critical workloads, etc.
Extending the cloud datacenter to support the non-functional requirements of converged workloads, including IoT, HPC, and big data services.
Experience reports and use-cases with understanding and engineering performance in the cloud datacenter.
Long-running topics of the HotCloudPerf workshop include, but are not limited to:
Empirical performance studies in cloud computing environments, applications, and systems, including observation, measurement, and surveys.
Comparative performance studies and benchmarking of cloud environments, applications, and systems.
Performance analysis using modeling and queueing theory for cloud environments, applications, and systems.
Simulation-based studies for all aspects of cloud computing performance.
Tuning and auto-tuning of systems operating in cloud environments, e.g., auto-scaling of resources and auto-tiering of data, optimized resource deployment.
Software patterns and architectures for engineering cloud performance, e.g., serverless.
Experience with and analysis of performance of cloud deployment models, including IaaS/PaaS/SaaS/FaaS.
End-to-end performance engineering for pipelines and workflows in cloud environments, or of applications with non-trivial SLAs.
Tools for monitoring and studying cloud computing performance.
General and specific methods and methodologies for understanding and engineering cloud performance.