April 2022

Conference Paper

Emulation Framework for Distributed Large-Scale Systems Integration

By:
Imam, Neena ; Rao, Nageswara S; Alnajjar, Anees M; Naughton III, Thomas J; Hitefield, Seth D
Page Number:
1-8
Book Title:
Proceedings of 16th Annual IEEE International Systems Conference
Publication Date:
April 2022
Publisher Location:
IEEE, New Jersey, United States of America
Conference Name:
16th Annual IEEE International Systems Conference
Conference Location:
Orlando (Virtual), Florida, United States of America
Conference Sponsor:
IEEE
View DOI Listing:
https://doi.org/10.1109/SysCon53536.2022.9773826

Abstract

Recent trends in systems engineering include integration of very large-scale systems, which entails significant challenges when they are geographically dispersed. In these scenarios, intelligent integration of distributed large-scale systems requires significant coordination among hardware elements as well as all software components. The approach of integrated systems (both computing platform and experimental equipment) for end-to-end orchestration is called federation. Virtual frameworks can aid in the testing, assessment, and implementation of a functional system of interconnected resources. We present an emulation framework that replicates the software environments of multi-site federations of computing systems and instruments. Our emulation framework allows systems engineers to reduce development cost and avoid disruptions to production infrastructure. Our framework was effectively used to develop and test software modules for various tasks including container orchestration and instrument access. For performance assessment, however, the emulated framework is severely limited in providing accurate network and IO measurements at 10 Gbps and higher data rates. The data transfer performance profiles estimated using these emulated measurements are usually inaccurate for high bandwidth and high latency connections, since emulation does not accurately reflect the critical network transport dynamics. We utilize measurements from a physical testbed with hardware network emulators to obtain data transfer profiles that closely match the expected profiles for the emulated federations. We show the effectiveness of our approach by an illustrative example of integrated (federated) multi-site ultra large-scale systems that are connected via high speed wide area networks.