Skip to main content
SHARE
Publication

Platform Agnostic Streaming Data Application Performance Models

Publication Type
Conference Paper
Journal Name
Redefining Scalability for Diversely Heterogeneous Architectures Workshop
Book Title
2021 IEEE/ACM Redefining Scalability for Diversely Heterogeneous Architectures Workshop (RSDHA)
Publication Date
Page Numbers
17 to 26
Issue
1
Publisher Location
New Jersey, United States of America
Conference Name
Redefining Scalability for Diversely Heterogeneous Architectures Workshop (RSDHA)
Conference Location
Saint Louis, Missouri, United States of America
Conference Sponsor
ACM/IEEE
Conference Date

The mapping of computational needs onto execution resources is, by and large, a manual task, and users are frequently guided simply by intuition and past experiences. We present a queueing theory based performance model for streaming data applications that takes steps towards a better understanding of resource mapping decisions, thereby assisting application developers to make good mapping choices. The performance model (and associated cost model) are agnostic to the specific properties of the compute resource and application, simply characterizing them by their achievable data throughput. We illustrate the model with a pair of applications, one chosen from the field of computational biology and the second is a classic machine learning problem.