-
Chapter and Conference Paper
The Adaptable IO System (ADIOS)
The Adaptable I/O System (ADIOS) provides a publish/subscribe abstraction for data access and storage. The framework provides various engines for producing and consuming data through different mediums (storage...
-
Chapter and Conference Paper
Transitioning from File-Based HPC Workflows to Streaming Data Pipelines with openPMD and ADIOS2
This paper aims to create a transition path from file-based IO to streaming-based workflows for scientific applications in an HPC environment. By using the openPMP-api, traditional workflows limited by filesys...
-
Chapter and Conference Paper
Data Federation Challenges in Remote Near-Real-Time Fusion Experiment Data Processing
Fusion energy experiments and simulations provide critical information needed to plan future fusion reactors. As next-generation devices like ITER move toward long-pulse experiments, analyses, including AI and...
-
Chapter and Conference Paper
VScope: Middleware for Troubleshooting Time-Sensitive Data Center Applications
Data-Intensive infrastructures are increasingly used for on-line processing of live data to guide operations and decision making. VScope is a flexible monitoring and analysis middleware for troubleshooting suc...
-
Article
DataStager: scalable data staging services for petascale applications
Known challenges for petascale machines are that (1) the costs of I/O for high performance applications can be substantial, especially for output tasks like checkpointing, and (2) noise from I/O actions can in...
-
Article
Middleware for enterprise scale data stream management using utility-driven self-adaptive information flows
We consider enterprise-wide information flows that are responsible for acquiring, processing and delivering operational information across the business units. Middleware that enables such aggregation of data-...
-
Chapter and Conference Paper
iManage: Policy-Driven Self-management for Enterprise-Scale Systems
It is obvious that big, complex enterprise systems are hard to manage. What is not obvious is how to make them more manageable. Although there is a growing body of research into system self-management, many te...
-
Chapter and Conference Paper
Utility-Driven Proactive Management of Availability in Enterprise-Scale Information Flows
Enterprises rely critically on the timely and sustained delivery of information. To support this need, we augment information flow middleware with new functionality that provides high levels of availability to...
-
Article
Open Metadata Formats: Efficient XML-Based Communication for High Performance Computing
High-performance computing faces considerable change as the Internet and the Grid mature. Applications that once were tightly-coupled and monolithic are now decentralized, with collaborating components spread ...
-
Chapter and Conference Paper
KECho— Event Communication for Distributed Kernel Services
Event services have received increased attention as scalable tools for the composition of large-scale, distributed systems, as evidenced by their successful deployment in interactive multimedia applications an...
-
Article
Event Services in High Performance Systems
The Internet and the Grid are changing the face of high performance computing. Rather than tightly-coupled SPMD-style components running in a single cluster, on a parallel machine, or even on the Internet prog...
