TY - GEN
T1 - Warped Input Gaussian Processes for Time Series Forecasting
AU - Vinokur, Igor
AU - Tolpin, David
N1 - Publisher Copyright:
© 2021, Springer Nature Switzerland AG.
PY - 2021/1/1
Y1 - 2021/1/1
N2 - Time series forecasting plays a vital role in system monitoring and novelty detection. However, commonly used forecasting methods are not suited for handling non-stationarity, while existing methods for forecasting in non-stationary time series are often complex to implement and involve expensive computations. We introduce a Gaussian process-based model for handling of non-stationarity. The warping is achieved non-parametrically, through imposing a prior on the relative change of distance between subsequent observation inputs. The model allows the use of general gradient optimization algorithms for training and incurs only a small computational overhead on training and prediction. The model finds its applications in forecasting in non-stationary time series with either gradually varying volatility, presence of change points, or a combination thereof. We implement the model in a probabilistic programming framework, evaluate on synthetic and real-world time series data comparing against both broadly used baselines and known state-of-the-art approaches and show that the model exhibits state-of-the-art forecasting performance at a lower implementation and computation cost, enabling efficient applications in diverse fields of system monitoring and novelty detection.
AB - Time series forecasting plays a vital role in system monitoring and novelty detection. However, commonly used forecasting methods are not suited for handling non-stationarity, while existing methods for forecasting in non-stationary time series are often complex to implement and involve expensive computations. We introduce a Gaussian process-based model for handling of non-stationarity. The warping is achieved non-parametrically, through imposing a prior on the relative change of distance between subsequent observation inputs. The model allows the use of general gradient optimization algorithms for training and incurs only a small computational overhead on training and prediction. The model finds its applications in forecasting in non-stationary time series with either gradually varying volatility, presence of change points, or a combination thereof. We implement the model in a probabilistic programming framework, evaluate on synthetic and real-world time series data comparing against both broadly used baselines and known state-of-the-art approaches and show that the model exhibits state-of-the-art forecasting performance at a lower implementation and computation cost, enabling efficient applications in diverse fields of system monitoring and novelty detection.
KW - Gaussian processes
KW - Non-stationarity
KW - Probabilistic programming
KW - Time series
UR - http://www.scopus.com/inward/record.url?scp=85112013990&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-78086-9_16
DO - 10.1007/978-3-030-78086-9_16
M3 - Conference contribution
AN - SCOPUS:85112013990
SN - 9783030780852
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 205
EP - 220
BT - Cyber Security Cryptography and Machine Learning - 5th International Symposium, CSCML 2021, Proceedings
A2 - Dolev, Shlomi
A2 - Margalit, Oded
A2 - Pinkas, Benny
A2 - Schwarzmann, Alexander
PB - Springer Science and Business Media Deutschland GmbH
T2 - 5th International Symposium on Cyber Security Cryptography and Machine Learning, CSCML 2021
Y2 - 8 July 2021 through 9 July 2021
ER -