Skip to main content
SHARE
Publication

Graph processing platforms at scale: practices and experiences...

by Seung-hwan Lim, Sangkeun M Lee, Tyler C Brown, Sreenivas R Sukumar, Gautam Ganesh
Publication Type
Conference Paper
Publication Date
Page Numbers
42 to 51
Conference Name
IEEE International Symposium on Performance Analysis of Systems and Software
Conference Location
Philadelphia, Pennsylvania, United States of America
Conference Date

Graph analysis unveils hidden associations of data in many phenomena and artifacts, such as road network, social networks, genomic information, and scientific collaboration. Unfortunately, a wide diversity in the characteristics of graphs and graph operations make it challenging to find a right combination of tools and implementation of algorithms to discover desired knowledge from the target data set. This study presents an extensive empirical study of three representative graph processing platforms: Pegasus, GraphX, and Urika. Each system represents a combination of options in data model, processing paradigm, and infrastructure. We benchmarked each platform using three popular graph operations, degree distribution, connected components, and PageRank over a variety of real-world graphs. Our experiments show that each graph processing platform shows different strength, depending the type of graph operations. While Urika performs the best in non-iterative operations like degree distribution, GraphX outputforms iterative operations like connected components and PageRank. In addition, we discuss challenges to optimize the performance of each platform over large scale real world graphs.