Autors: Kougioumtzidis, G. V., Poulkov, V. K., Lazaridis P.I., Zaharis Z.D.
Title: Mobile Network Traffic Prediction Using Temporal Fusion Transformer
Keywords: Deep learning, mobile network traffic prediction, temporal fusion transformer, time series prediction

Abstract: The continuous development of mobile communication technologies has led to a rapid increase in cellular network traffic. Therefore, traffic prediction models have become very important for the design of mobile communication networks, as they are essential for increasing the quality of service (QoS) and ensuring a high level of quality of experience (QoE). Accurate and timely prediction of network traffic volume enables efficient planning of radio resource allocation, improves network energy efficiency, and reduces network congestion and operational costs. However, the task of mobile network traffic prediction is inherently challenging due to the dynamic, multivariate nature of traffic patterns that are influenced by diverse factors such as location, user behavior, and temporal variations. In this paper, we propose a novel prediction model based on deep learning techniques. Specifically, we develop a customized temporal fusion transformer (TFT) for accurate time series prediction that effectively captures the complex dependencies in mobile network traffic and ensures resilience to unexpected variations, which is critical for efficient network management and QoE enhancement. The prediction model is evaluated and tested against state-of-the-art prediction models using real-world cellular network data as the training dataset. The experimental results validate the excellence of this customized transformer architecture in capturing the complex temporal dynamics of cellular network traffic by exploiting attention-based mechanisms.

References

  1. Ericsson, "Ericsson Mobility Report," Jun. 2021.
  2. W. Long, R. Chen, M. Moretti, W. Zhang, and J. Li, “A Promising Technology for 6G Wireless Networks: Intelligent Reflecting Surface,” Journal of Communications and Information Networks, vol. 6, no. 1, pp. 1–16, Mar. 2021.
  3. L. Li, Y. Zhao, J. Wang, and C. Zhang, “Wireless Traffic Prediction Based on a Gradient Similarity Federated Aggregation Algorithm,” Applied Sciences, vol. 13, no. 6, p. 4036, Jan. 2023.
  4. W. Wang, C. Zhou, H. He, W. Wu, W. Zhuang, and X. Shen, “Cellular Traffic Load Prediction with LSTM and Gaussian Process Regression,” in ICC 2020 - 2020 IEEE International Conference on Communications (ICC), Jun. 2020, pp. 1–6.
  5. R. Li et al., “Intelligent 5G: When Cellular Networks Meet Artificial Intelligence,” IEEE Wireless Communications, vol. 24, no. 5, pp. 175–183, Oct. 2017.
  6. A. D’Alconzo, A. Coluccia, F. Ricciato, and P. Romirer-Maierhofer, “A Distribution-Based Approach to Anomaly Detection and Application to 3G Mobile Traffic,” in GLOBECOM 2009 - 2009 IEEE Global Telecommunications Conference, Nov. 2009, pp. 1–8.
  7. T. Tokunaga and K. Mizutani, “A Comprehensive Evaluation of Generating a Mobile Traffic Data Scheme without a Coarse-Grained Process Using CSR-GAN,” Sensors, vol. 22, no. 5, p. 1930, Jan. 2022.
  8. C. Zhang, H. Zhang, D. Yuan, and M. Zhang, “Citywide Cellular Traffic Prediction Based on Densely Connected Convolutional Neural Networks,” IEEE Communications Letters, vol. 22, no. 8, pp. 1656–1659, Aug. 2018.
  9. C. Zhang, P. Patras, and H. Haddadi, “Deep Learning in Mobile and Wireless Networking: A Survey,” IEEE Communications Surveys & Tutorials, vol. 21, no. 3, pp. 2224–2287, 2019.
  10. N. Kato, B. Mao, F. Tang, Y. Kawamoto, and J. Liu, “Ten Challenges in Advancing Machine Learning Technologies toward 6G,” IEEE Wireless Communications, vol. 27, no. 3, pp. 96–103, Jun. 2020.
  11. S. F. Stefenon, L. O. Seman, L. S. A. da Silva, V. C. Mariani, and L. dos S. Coelho, “Hypertuned temporal fusion transformer for multi-horizon time series forecasting of dam level in hydroelectric power plants,” International Journal of Electrical Power & Energy Systems, vol. 157, p. 109876, Jun. 2024.
  12. S. Huang et al., “MEAformer: An all-MLP transformer with temporal external attention for long-term time series forecasting,” Information Sciences, vol. 669, p. 120605, May 2024.
  13. Y. Yu, R. Ma, and Z. Ma, “Robformer: A robust decomposition transformer for long-term time series forecasting,” Pattern Recognition, vol. 153, p. 110552, Sep. 2024.
  14. C. Yang, Y. Wang, B. Yang, and J. Chen, “GRAformer: A gated residual attention transformer for multivariate time series forecasting,” Neurocomputing, vol. 581, p. 127466, May 2024.
  15. L. de Azevedo Takara, A. C. Teixeira, H. Yazdanpanah, V. C. Mariani, and L. dos Santos Coelho, “Optimizing multi-step wind power forecasting: Integrating advanced deep neural networks with stacking-based probabilistic learning,” Applied Energy, vol. 369, p. 123487, Sep. 2024.
  16. J. Wan, N. Xia, Y. Yin, X. Pan, J. Hu, and J. Yi, “TCDformer: A transformer framework for non-stationary time series forecasting based on trend and change-point detection,” Neural Networks, vol. 173, p. 106196, May 2024.
  17. B. Lim, S. Ö. Arık, N. Loeff, and T. Pfister, “Temporal Fusion Transformers for interpretable multi-horizon time series forecasting,” International Journal of Forecasting, vol. 37, no. 4, pp. 1748–1764, Oct. 2021.
  18. S. Zhan et al., “Cell Traffic Prediction Based on Convolutional Neural Network for Software-Defined Ultra-Dense Visible Light Communication Networks,” Security and Communication Networks, vol. 2021, pp. 1-10, Aug. 2021.
  19. F. W. Alsaade and M. Hmoud Al-Adhaileh, “Cellular Traffic Prediction Based on an Intelligent Model,” Mobile Information Systems, vol. 2021, pp. 1-15, Aug. 2021.
  20. S. H.s and C. B.m, “Cellular Traffic Prediction through Multi-Layer Hybrid Network Domain,” Mathematical Statistician and Engineering Applications, vol. 71, no. 4, pp. 6189–6201, Nov. 2022.
  21. L. Chen, D. Yang, D. Zhang, C. Wang, J. Li, and T.-M.-T. Nguyen, “Deep mobile traffic forecast and complementary base station clustering for C-RAN optimization,” Journal of Network and Computer Applications, vol. 121, pp. 59–69, Nov. 2018.
  22. X. Sun, B. Wei, J. Gao, D. Cao, Z. Li and Y. Li, "Spatio-Temporal Cellular Network Traffic Prediction Using Multi-Task Deep Learning for AI-Enabled 6G," Journal of Beijing Institute of Technology, vol. 31, no. 5, pp. 441-453, 2022.
  23. S. Moghadas, C. Fiandrino, A. Collet, G. Attanasio, M. Fiore, and J. Widmer, “Spotting Deep Neural Network Vulnerabilities in Mobile Traffic Forecasting with an Explainable AI Lens,” in IEEE INFOCOM 2023 - IEEE Conference on Computer Communications, May 2023, pp. 1–10.
  24. J. Feng, X. Chen, R. Gao, M. Zeng, and Y. Li, “DeepTP: An End-to-End Neural Network for Mobile Cellular Traffic Prediction,” IEEE Network, vol. 32, no. 6, pp. 108–115, Nov. 2018.
  25. S. Jaffry and S. F. Hasan, “Cellular Traffic Prediction using Recurrent Neural Networks,” in 2020 IEEE 5th International Symposium on Telecommunication Technologies (ISTT), Nov. 2020, pp. 94–98.
  26. V. S. Dommaraju et al., “ECMCRR-MPDNL for Cellular Network Traffic Prediction With Big Data,” IEEE Access, vol. 8, pp. 113419–113428, 2020.
  27. Q. Zeng, Q. Sun, G. Chen, H. Duan, C. Li, and G. Song, “Traffic Prediction of Wireless Cellular Networks Based on Deep Transfer Learning and Cross-Domain Data,” IEEE Access, vol. 8, pp. 172387–172397, 2020.
  28. B. Gu, J. Zhan, S. Gong, W. Liu, Z. Su, and M. Guizani, “A Spatial-Temporal Transformer Network for City-Level Cellular Traffic Analysis and Prediction,” IEEE Transactions on Wireless Communications, vol. 22, no. 12, pp. 9412–9423, Dec. 2023.
  29. Q. Liu, J. Li, and Z. Lu, “ST-Tran: Spatial-Temporal Transformer for Cellular Traffic Prediction,” IEEE Communications Letters, vol. 25, no. 10, pp. 3325–3329, Oct. 2021, doi: 10.1109/LCOMM.2021.3098557.
  30. I. Guarino, G. Aceto, D. Ciuonzo, A. Montieri, V. Persico, and A. Pescapè, “Explainable Deep-Learning Approaches for Packet-Level Traffic Prediction of Collaboration and Communication Mobile Apps,” IEEE Open Journal of the Communications Society, vol. 5, pp. 1299–1324, 2024.
  31. L. Xu et al., “TransMUSE: Transferable Traffic Prediction in MUltiService Edge Networks,” Computer Networks, vol. 221, p. 109518, Feb. 2023.
  32. Y. Fang, S. Ergüt, and P. Patras, “SDGNet: A Handover-Aware Spatiotemporal Graph Neural Network for Mobile Traffic Forecasting,” IEEE Communications Letters, vol. 26, no. 3, pp. 582–586, Mar. 2022.
  33. A. Montieri, G. Bovenzi, G. Aceto, D. Ciuonzo, V. Persico, and A. Pescapè, “Packet-level prediction of mobile-app traffic using multitask Deep Learning,” Computer Networks, vol. 200, p. 108529, Dec. 2021.
  34. P. Kaushik, S. Singh, and P. Yadav, “Traffic Prediction in Telecom Systems Using Deep Learning,” in 2018 7th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO), Aug. 2018, pp. 302–307.
  35. Z. Gao, “5G Traffic Prediction Based on Deep Learning,” Computational Intelligence and Neuroscience, vol. 2022, Jun. 2022.
  36. G. Feng, L. Zhang, F. Ai, Y. Zhang, and Y. Hou, “An Improved Temporal Fusion Transformers Model for Predicting Supply Air Temperature in High-Speed Railway Carriages,” Entropy, vol. 24, no. 8, p. 1111, Aug. 2022.
  37. G. O. Ferreira, C. Ravazzi, F. Dabbene, G. C. Calafiore, and M. Fiore, “Forecasting Network Traffic: A Survey and Tutorial With Open-Source Comparative Evaluation,” IEEE Access, vol. 11, pp. 6018–6044, 2023.
  38. D. Bega, M. Gramaglia, M. Fiore, A. Banchs, and X. Costa-Perez, “DeepCog: Cognitive Network Management in Sliced 5G Networks with Deep Learning,” in IEEE INFOCOM 2019 - IEEE Conference on Computer Communications, Apr. 2019, pp. 280–288.
  39. D.-A. Clevert, T. Unterthiner and S. Hochreiter, "Fast and accurate deep network learning by exponential linear units (elus)," [Online]. Available: https://arxiv.org/abs/1511.07289, Nov. 2015.
  40. J. L. Ba, J. R. Kiros and G. E. Hinton, "Layer Normalization," [Online]. Available: https://arxiv.org/abs/1607.06450, Jul. 2016.
  41. S. Li, X. Jin, Y. Xuan, X. Zhou, W. Chen, Y.-X. Wang and X. Yan, "Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting," in Proc. of the 33rd Conf. on Neural Information Processing Systems (NeurIPS 2019), Vancouver, Canada, Dec. 8-14, 2019.
  42. A. Vaswani et al., "Attention is all you need," in Proc. of the 31st Conf. on Neural Information Processing Systems (NeurIPS 2017), Long Beach, California, USA, Dec. 4-9, 2017.
  43. R. Wen, K. Torkkola, B. Narayanaswamy, and D. Madeka, "A Multi-Horizon Quantile Recurrent Forecaster," [Online]. Available: https://arxiv.org/abs/1711.11053, Jun, 2018.
  44. G. Barlacchi et al., “A multi-source dataset of urban life in the city of Milan and the Province of Trentino,” Sci Data, vol. 2, no. 1, p. 150055, Oct. 2015.
  45. R. J. Hyndman and A. B. Koehler, “Another look at measures of forecast accuracy,” International Journal of Forecasting, vol. 22, no. 4, pp. 679–688, Oct. 2006.

Issue

IEEE Transactions on Artificial Intelligence, 2025, United States, https://doi.org/10.1109/TAI.2025.3556627

Copyright Institute of Electrical and Electronics Engineers Inc.

Цитирания (Citation/s):
1. Chen K., Zhang L., Zhong J., Space-Air-Ground Integrated Network (SAGIN) in Disaster Management: A Survey, 2025, IEEE Transactions on Network and Service Management, issue 0, DOI 10.1109/TNSM.2025.3580965, eissn 19324537 - 2025 - в издания, индексирани в Scopus
2. Ren Y., Zhou L., Guo S., Qiu X., Quek T.Q.S., Traffic Digital Twin-Enabled Orchestration and Scheduling in O-RAN: A Multi-Timescale Joint Optimization Approach, 2025, IEEE Transactions on Mobile Computing, issue 0, DOI 10.1109/TMC.2025.3622895, issn 15361233, eissn 15580660 - 2025 - в издания, индексирани в Scopus
3. Koumar J., Smolen T., Jerabek K., Cejka T., Comparative Analysis of Deep Learning Models for Real-World ISP Network Traffic Forecasting, 2025, IEEE Transactions on Network and Service Management, issue 0, DOI 10.1109/TNSM.2025.3636557, eissn 19324537 - 2025 - в издания, индексирани в Scopus
4. Samudrala D.S., Senapati R., Advanced temporal attention mechanism based traffic prediction model for 5G and beyond cellular networks, 2025, ICT Express, issue 0, DOI 10.1016/j.icte.2025.12.004, eissn 24059595 - 2025 - в издания, индексирани в Scopus
5. Dhaka P., Sreejeth M., Tripathi M.M., Physics-Informed Adaptive Conformal Prediction for Wind Power under Dynamic Weather Regimes, 2026, IEEE Transactions on Industry Applications, issue 0, DOI 10.1109/TIA.2026.3653910, issn 00939994, eissn 19399367 - 2026 - в издания, индексирани в Scopus
6. Najafi S., Sepanj M.H., Jafari F., RadarSeq: A Temporal Vision Framework for User Churn Prediction via Radar Chart Sequences, 2026, Lecture Notes in Computer Science, issue 0, vol. 16125 LNCS, pp. 629-646, DOI 10.1007/978-3-032-12840-9_40, issn 03029743, eissn 16113349 - 2026 - в издания, индексирани в Scopus
7. Jiang X., Chen S., Gou J., Zhang Z., Zhuge B., Dong L., Automated network traffic prediction framework based on meta-feature mapping and empirical black-winged kite optimization, 2025, Tongxin Xuebao Journal on Communications, issue 12, vol. 46, pp. 01-02, DOI 10.11959/j.issn.1000-436x.2025215, issn 1000436X - 2025 - в издания, индексирани в Scopus
8. Siddiqui A.B., Hussein M., Yang H., Large-scale traffic safety management using Temporal Fusion Transformers: Prediction, interpretation, and intervention analysis, 2026, Journal of Transportation Safety and Security, issue 0, DOI 10.1080/19439962.2026.2628823, issn 19439962, eissn 19439970 - 2026 - в издания, индексирани в Scopus
9. Samudrala D.S., Senapati R., Spatio temporal attention mechanism for real time cellular traffic prediction, 2026, Peerj Computer Science, issue 0, vol. 12, DOI 10.7717/peerj-cs.3571, eissn 23765992 - 2026 - в издания, индексирани в Scopus
10. Gu W., Pan X., Liang X., Cui Z., Short-term dissolved oxygen forecasting in lakes of the middle and lower Yangtze River basin using generative AI–enhanced machine learning, 2026, Journal of Hydrology Regional Studies, issue 0, DOI 10.1016/j.ejrh.2026.103338, eissn 22145818 - 2026 - в издания, индексирани в Scopus
11. Gao D., Gao L., Xia N., Liu X., Wang D., Liu Y., Peng M., Energy-Efficient Communication and Computing Integrated gNBs in Radio CPNs: a Dual Deep Learning Framework for Joint Demand Prediction and Sleep Control, 2026, IEEE Transactions on Mobile Computing, issue 0, DOI 10.1109/TMC.2026.3690157, issn 15361233, eissn 15580660 - 2026 - в издания, индексирани в Scopus
12. Naveen V., Ashwitha G., Varshika B., Mohana J., Sakthivel M., Asha R., Adaptive AI Financial Ecosystem: Proactive Crisis Prediction and Policy Simulation Using GNN and Reinforcement Learning, 2026, Proceedings of the 4th International Conference on Augmented Intelligence and Sustainable Systems Icaiss 2026, issue 0, pp. 600-607, DOI 10.1109/ICAISS68683.2026.11526617 - 2026 - в издания, индексирани в Scopus
13. Jiang F., Cai J., Zhang X., Liu L., Wang C., Transformer Based on Kolmogorov-Arnold Networks for Fine-Grained Network Throughput Prediction, 2026, 2026 IEEE Wireless Communications and Networking Conference Workshops Wcncw 2026, issue 0, DOI 10.1109/WCNCW67598.2026.11555517 - 2026 - в издания, индексирани в Scopus

Вид: статия в списание, публикация в издание с импакт фактор, публикация в реферирано издание, индексирана в Scopus