Search arXivSearch

arXiv · 2502.13495

A Study on Monthly Marine Heatwave Forecasts in New Zealand: An Investigation of Imbalanced Regression Loss Functions with Neural Network Models

Abstract

Marine heatwaves (MHWs) are extreme ocean-temperature events with significant impacts on marine ecosystems and related industries. Accurate forecasts (one to six months ahead) of MHWs would aid in mitigating these impacts. However, forecasting MHWs presents a challenging imbalanced regression task due to the rarity of extreme temperature anomalies in comparison to more frequent moderate conditions. In this study, we examine monthly MHW forecasts for 12 locations around New Zealand. We use a fully-connected neural network and compare standard and specialized regression loss functions, including the mean squared error (MSE), the mean absolute error (MAE), the Huber, the weighted MSE, the focal-R, the balanced MSE, and a proposed scaling-weighted MSE. Results show that (i) short lead times (one month) are considerably more predictable than three- and six-month leads, (ii) models trained with the standard MSE or MAE losses excel at forecasting average conditions but struggle to capture extremes, and (iii) specialized loss functions such as the balanced MSE and our scaling-weighted MSE substantially improve forecasting of MHW and suspected MHW events. These findings underscore the importance of tailored loss functions for imbalanced regression, particularly in forecasting rare but impactful events such as MHWs.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Ding Ning, Varvara Vetrova, Sébastien Delaux, Rachael Tappenden, Karin R. Bryan, Yun Sing Koh. 2025-02-19. A Study on Monthly Marine Heatwave Forecasts in New Zealand: An Investigation of Imbalanced Regression Loss Functions with Neural Network Models. https://arxiv.org/abs/2502.13495

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Conservation Constraints and Distributed Advective Memory in a Reduced Model of Atlantic Overturning Hysteresis

Interbasin exchange through the Indo-Pacific gateway supplies salt to the Atlantic and is widely invoked as a control on the stability of the Atlantic overturning circulation. We ask whether that control can act on the equilibrium structure of a conceptual thermohaline model. A closed five-box model with an exact salt invariant is constructed, comprising North Atlantic, upper-limb, Indian, Pacific, and deep reservoirs, with the return flow split between a warm route through the Indian reservoir and a cold route, together with an Indonesian Throughflow branch and an Agulhas retroflection. Adding the steady-state budgets of the gateway reservoirs shows that every internal exchange cancels, so the salt they export to the Atlantic is fixed by the net Atlantic freshwater export alone. This holds independently of the warm-route fraction, the throughflow, the retroflection, and how the export is apportioned among gateway reservoirs; across a parameter sweep the largest departure is of order ten to the minus eleven. The gateway therefore enters as a purely additive forcing and cannot renormalize the salt-advection feedback. Replacing the discrete transit lag by a gamma memory kernel leaves the equilibria unchanged but yields a closed-form threshold for oscillatory instability depending only on kernel shape. Broad memory is strongly stabilizing, and a discrete lag is the least stable member of the family. Because the instantaneous feedback vanishes at the fold, oscillatory instability always precedes the saddle-node, over an interval widening more than tenfold as memory sharpens. Gateways therefore appear to act on transient rather than equilibrium dynamics

physics.ao-ph

Forecasting threshold exceedance of atmospheric variables at a specific location

Accurate short-term forecasting of extreme weather events is important for early warning and risk mitigation. We compare two approaches for predicting site-specific threshold exceedances of weather variables: direct binary probabilistic models trained on thresholded outcomes and full-distribution parametric models trained on the continuous target. Using an analytically tractable Gaussian random-location model, in which the distribution is predictably shifted by the covariates, we quantify the consequences of the information loss induced by thresholding and derive the rare-event behavior of prediction errors and forecast skill. The analysis predicts an increasing relative advantage of the full-distribution approach as event probability decreases, because binarization progressively discards information contained in the continuous response. We then compare the two approaches to forecast wind speed and accumulated rainfall at various weather station sites over southeastern France using the same hybrid neural-network architecture. Although wind speed and rainfall depart from the toy-model assumptions, its main qualitative predictions are recovered for both variables: the relative advantage of distributional modeling increases toward rarer thresholds. This agreement further suggests that a substantial fraction of the forecastable signal associated with extreme events arises from predictable shifts in the conditional distribution. For the reasonably suitable parametric families examined, the results show limited sensitivity to the selected class of distribution. Overall, the results highlight the statistical advantage of training on continuous observations rather than on thresholded binary outcomes when forecasting rare threshold exceedances.

physics.ao-ph

Blinded Evaluation of Oceanic Sound Source Locations via Sequential Bound Estimation

A non-linear, non-Bayesian method called sequential bound estimation (SBE) derived 100% confidence intervals of location (CIL) for 219 explosions in the ocean from measurements of their time differences of arrivals among five widely-spaced time-unsynchronized receivers on the ocean bottom. The explosion's locations were measured with the global positioning system. A blind evaluation revealed all 219 explosions were within their CIL. The probability this could happen by chance is $4 \times 10^{-116}$. The explosions were detonated in shallow water on the eastern continental shelf of the U.S. over the so-called New England Mud Patch.

physics.ao-ph