Presentation
Poster 145: Improving Data Compression with Deep Predictive Neural Network for Time Evolutional Data
SessionResearch Posters Display
Event Type
Posters
Research Posters
TP
EX
EXH
TimeThursday, 21 November 20198:30am - 5pm
LocationE Concourse
DescriptionScientific applications/simulations periodically generate huge intermediate data. Storing or transferring such a large scale of data is critical. Fast I/O is important for making this process faster. One of the approaches to achieve fast I/O is data compression. Our goal is to achieve a delta technique that can improve the performance of existing data compression algorithms for time evolutional intermediate data.
In our approach, we compute the delta values from original data and data predicted by the deep predictive neural network. We pass these delta values through three phases which are preprocessing phase, partitioned entropy coding phase, and density-based spatial delta encoding phase.
In our poster, we present how our predictive delta technique can leverage the time evolutional data to produce highly concentrated small values. We show the improvement in compression ratio when our technique, combined with existing compression algorithms, are applied on the intermediate data for different datasets.
In our approach, we compute the delta values from original data and data predicted by the deep predictive neural network. We pass these delta values through three phases which are preprocessing phase, partitioned entropy coding phase, and density-based spatial delta encoding phase.
In our poster, we present how our predictive delta technique can leverage the time evolutional data to produce highly concentrated small values. We show the improvement in compression ratio when our technique, combined with existing compression algorithms, are applied on the intermediate data for different datasets.
Archive
Authors
