Presentation
Poster 121: HFlush: Realtime Flushing for Modern Storage Environments
SessionResearch Posters Display
Event Type
Posters
Research Posters
TP
EX
EXH
TimeThursday, 21 November 20198:30am - 5pm
LocationE Concourse
DescriptionDue to the unparalleled magnitude of data movement in extreme scale computing, I/O has become a central challenge. Modern storage environments have proposed the use of multiple layers between applications and the PFS. Nonetheless, the difference in capacities and speeds between storage layers makes it extremely challenging to evict data from upper layers to lower layers efficiently. However, current solutions are executed in batches, compromising latency; are also push-based implementations, compromising resource utilization. Hence, we propose HFlush, a continuous data eviction mechanism built on a streaming architecture that is pull-based and in which each component is decoupled and executed in parallel. Initial results have shown RFlush to obtain a 7X latency reduction and a 2X bandwidth improvement over a baseline batch-based system. Therefore, RFlush is a promising solution to the growing challenges of extreme scale data generation and eviction shortcomings when archiving data across multiple tiers of storage.
Archive
