Copyright Notice:

The documents distributed by this server have been provided by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a noncommercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Publications of SPCL

A. Pietak, L. Huang, L. Fusco, M. Sprenger, S. Schemm, a. Torsten Hoefler:

 psit 1.0: a system to compress Lagrangian flows

(Geoscientific Model Development. Vol 13, Nr. 19, Copernicus Publications, May 2026, )

Publisher Reference

Abstract

Meteorological simulations produce large amounts of data, which can represent a challenge when trying to store, share, and analyze it. As weather and climate models increasingly simulate the atmosphere at higher spatio-temporal resolution, it becomes imperative to compress the data effectively. While compression algorithms exist for weather data stored in a gridded Eulerian frame, there are, to date, no specialized alternatives for data stored in the Lagrangian frame. In this study, we present psit, a system to compress weather data stored in the Lagrangian frame. The system works by mapping the trajectories to a grid structure, performing additional encodings on these, and passing them to either the JPEG 2000 image compression algorithm or SZ3. The specialty of the algorithm is the mapping phase and the following encodings, which generate the grids in a way that allows the aforementioned compression algorithms to perform well. To gauge the performance of psit, we test a variety of metrics. We demonstrate that in the majority of cases, equivalent or superior compression performance is attained through the utilization of psit as opposed to naive compression with ZFP or SZ3. We also compare compression with measurement inaccuracies. Here, we show that the density of 168 hour long trajectories compressed with a ratio in the range of 30 to 40 behaves similarly to trajectories calculated from uncompressed wind fields with additional random perturbations with magnitude of 0.1 m s^−1 in the horizontal and around 6×10^−3 Pa s^−1 in the vertical component. Additionally, we conduct two case studies in which we discuss the impact of compression on the study of warm conveyor belts associated with extratropical cyclones and the impact of compression on the radioactive plume prediction of the Fukushima incident in 2011.

Documents

download article:
 

BibTeX

@article{,
  author={Alexander Pietak and Langwen Huang and Luigi Fusco and Michael Sprenger and Sebastian Schemm and and Torsten Hoefler},
  title={{psit 1.0: a system to compress Lagrangian flows}},
  journal={Geoscientific Model Development},
  year={2026},
  month={05},
  volume={13},
  number={19},
  publisher={Copernicus Publications},
  note={},
}