articleExpert Systems with ApplicationsApr 21, 2022HYBRID OA

A multi-head attention-based transformer model for traffic flow forecasting with a comparative analysis to recurrent neural networks

Universidade do Porto

Indexed incrossref

Abstract

Traffic flow forecasting is an essential component of an intelligent transportation system to mitigate congestion. Recurrent neural networks, particularly gated recurrent units and long short-term memory, have been the state-of-the-art traffic flow forecasting models for the last few years. However, a more sophisticated and resilient model is necessary to effectively acquire long-range correlations in the time-series data sequence under analysis. The dominant performance of transformers by overcoming the drawbacks of recurrent neural networks in natural language processing might tackle this need and lead to successful time-series forecasting. This article presents a multi-head attention based transformer model…

Citation impact

273
total citations
FWCI
26.66
Percentile
100%
References
46
Citations per year

Authors

4

Topics & keywords

Keywords
  • Computer science
  • Transformer
  • Recurrent neural network
  • Artificial neural network
  • Encoder
  • Time series
  • Artificial intelligence
  • Long short term memory
No related works found for this paper.

Funding