Weather4cast at NeurIPS 2023 – Data Fusion for Quantitative Hi-Res Rain Movie Prediction under Spatio-temporal Shifts

Aleksandra Gruca, Xavier Calbet, Pilar Rípodas, Llorenç Lliso, Federico Serva, Bertrand Le Saux, Lu Han, Xu-Yang Chen, Han-Jia Ye, De-Chuan Zhan, P. Jyoteeshkumar Reddy, Harish Baki, Sandeep Chinta, Pablo Izquierdo Ayala, Akshay Punjabi, Ajitabh Kumar, Rafael Pablos Sarabia, Ira Assent, Joachim Nyborg, Morten Birk, David P. Kreil
Proceedings of the NeurIPS 2023-2025 Competition Track, PMLR 276:90-105, 2026.

Abstract

Now in its third year, Weather4cast 2023 again advanced modern algorithms in AI and machine learning through a highly topical interdisciplinary challenge at the NeurIPS Competition Track. Predicting hi-res rain radar movies from multi-band satellite sensors required data fusion of complementary signal sources and video frame prediction with super-resolution techniques. This year, quantitative prediction of rain rates was assessed using a balanced multi-class metric. Accurate rain predictions are ever more critical for everyone, with climate change increasing the frequency of extreme precipitation events. Weather4cast models thus have a particular impact for the many regions on Earth where costly weather radar data are not available. We here present highlights and insights emerging from the competition. To reward models extracting relevant mechanistic patterns reflecting the underlying complex weather systems, our evaluation tested their responses to spatio-temporal shifts. Algorithms needed to forecast 4 h or 8 h of ground-based hi-res precipitation radar from lo-res satellite spectral images in a unique cross-sensor prediction challenge, and were evaluated within and across a variety of regions on Earth with diverse climate and different distributions of heavy precipitation events. Robustness to distributional shifts over time was achieved by testing predictions on data one year after the training period. Notably, the capability of models to correctly capture spatio-temporal patterns qualitatively varied considerably and was not always in line with leaderboard scores. This suggests that more sophisticated metrics will be required to accurately reflect the effectiveness of AI models in corresponding meteorological applications. Weather4cast will continue to explore the expansive data set and advance benchmark challenges in the field en route to validated foundation models for weather.

Cite this Paper


BibTeX
@InProceedings{pmlr-v276-gruca26a, title = {Weather4cast at {NeurIPS} 2023 – Data Fusion for Quantitative Hi-Res Rain Movie Prediction under Spatio-temporal Shifts}, author = {Gruca, Aleksandra and Calbet, Xavier and R{\'i}podas, Pilar and Lliso, Lloren{\c c} and Serva, Federico and Le Saux, Bertrand and Han, Lu and Chen, Xu-Yang and Ye, Han-Jia and Zhan, De-Chuan and Reddy, P. Jyoteeshkumar and Baki, Harish and Chinta, Sandeep and Izquierdo Ayala, Pablo and Punjabi, Akshay and Kumar, Ajitabh and Pablos Sarabia, Rafael and Assent, Ira and Nyborg, Joachim and Birk, Morten and Kreil, David P.}, booktitle = {Proceedings of the NeurIPS 2023-2025 Competition Track}, pages = {90--105}, year = {2026}, editor = {Qin, Tao and Zhang, Kun and Frellsen, Jes}, volume = {276}, series = {Proceedings of Machine Learning Research}, month = {02--07 Dec}, publisher = {PMLR}, pdf = {https://raw.githubusercontent.com/mlresearch/v276/main/assets/gruca26a/gruca26a.pdf}, url = {https://proceedings.mlr.press/v276/gruca26a.html}, abstract = {Now in its third year, Weather4cast 2023 again advanced modern algorithms in AI and machine learning through a highly topical interdisciplinary challenge at the NeurIPS Competition Track. Predicting hi-res rain radar movies from multi-band satellite sensors required data fusion of complementary signal sources and video frame prediction with super-resolution techniques. This year, quantitative prediction of rain rates was assessed using a balanced multi-class metric. Accurate rain predictions are ever more critical for everyone, with climate change increasing the frequency of extreme precipitation events. Weather4cast models thus have a particular impact for the many regions on Earth where costly weather radar data are not available. We here present highlights and insights emerging from the competition. To reward models extracting relevant mechanistic patterns reflecting the underlying complex weather systems, our evaluation tested their responses to spatio-temporal shifts. Algorithms needed to forecast 4 h or 8 h of ground-based hi-res precipitation radar from lo-res satellite spectral images in a unique cross-sensor prediction challenge, and were evaluated within and across a variety of regions on Earth with diverse climate and different distributions of heavy precipitation events. Robustness to distributional shifts over time was achieved by testing predictions on data one year after the training period. Notably, the capability of models to correctly capture spatio-temporal patterns qualitatively varied considerably and was not always in line with leaderboard scores. This suggests that more sophisticated metrics will be required to accurately reflect the effectiveness of AI models in corresponding meteorological applications. Weather4cast will continue to explore the expansive data set and advance benchmark challenges in the field en route to validated foundation models for weather.} }
Endnote
%0 Conference Paper %T Weather4cast at NeurIPS 2023 – Data Fusion for Quantitative Hi-Res Rain Movie Prediction under Spatio-temporal Shifts %A Aleksandra Gruca %A Xavier Calbet %A Pilar Rípodas %A Llorenç Lliso %A Federico Serva %A Bertrand Le Saux %A Lu Han %A Xu-Yang Chen %A Han-Jia Ye %A De-Chuan Zhan %A P. Jyoteeshkumar Reddy %A Harish Baki %A Sandeep Chinta %A Pablo Izquierdo Ayala %A Akshay Punjabi %A Ajitabh Kumar %A Rafael Pablos Sarabia %A Ira Assent %A Joachim Nyborg %A Morten Birk %A David P. Kreil %B Proceedings of the NeurIPS 2023-2025 Competition Track %C Proceedings of Machine Learning Research %D 2026 %E Tao Qin %E Kun Zhang %E Jes Frellsen %F pmlr-v276-gruca26a %I PMLR %P 90--105 %U https://proceedings.mlr.press/v276/gruca26a.html %V 276 %X Now in its third year, Weather4cast 2023 again advanced modern algorithms in AI and machine learning through a highly topical interdisciplinary challenge at the NeurIPS Competition Track. Predicting hi-res rain radar movies from multi-band satellite sensors required data fusion of complementary signal sources and video frame prediction with super-resolution techniques. This year, quantitative prediction of rain rates was assessed using a balanced multi-class metric. Accurate rain predictions are ever more critical for everyone, with climate change increasing the frequency of extreme precipitation events. Weather4cast models thus have a particular impact for the many regions on Earth where costly weather radar data are not available. We here present highlights and insights emerging from the competition. To reward models extracting relevant mechanistic patterns reflecting the underlying complex weather systems, our evaluation tested their responses to spatio-temporal shifts. Algorithms needed to forecast 4 h or 8 h of ground-based hi-res precipitation radar from lo-res satellite spectral images in a unique cross-sensor prediction challenge, and were evaluated within and across a variety of regions on Earth with diverse climate and different distributions of heavy precipitation events. Robustness to distributional shifts over time was achieved by testing predictions on data one year after the training period. Notably, the capability of models to correctly capture spatio-temporal patterns qualitatively varied considerably and was not always in line with leaderboard scores. This suggests that more sophisticated metrics will be required to accurately reflect the effectiveness of AI models in corresponding meteorological applications. Weather4cast will continue to explore the expansive data set and advance benchmark challenges in the field en route to validated foundation models for weather.
APA
Gruca, A., Calbet, X., Rípodas, P., Lliso, L., Serva, F., Le Saux, B., Han, L., Chen, X., Ye, H., Zhan, D., Reddy, P.J., Baki, H., Chinta, S., Izquierdo Ayala, P., Punjabi, A., Kumar, A., Pablos Sarabia, R., Assent, I., Nyborg, J., Birk, M. & Kreil, D.P.. (2026). Weather4cast at NeurIPS 2023 – Data Fusion for Quantitative Hi-Res Rain Movie Prediction under Spatio-temporal Shifts. Proceedings of the NeurIPS 2023-2025 Competition Track, in Proceedings of Machine Learning Research 276:90-105 Available from https://proceedings.mlr.press/v276/gruca26a.html.

Related Material