Е-Публикации
Технически университет - София

Abstract: The continuous development of mobile communication technologies has led to a rapid increase in cellular network traffic. Therefore, traffic prediction models have become very important for the design of mobile communication networks, as they are essential for increasing the quality of service (QoS) and ensuring a high level of quality of experience (QoE). Accurate and timely prediction of network traffic volume enables efficient planning of radio resource allocation, improves network energy efficiency, and reduces network congestion and operational costs. However, the task of mobile network traffic prediction is inherently challenging due to the dynamic, multivariate nature of traffic patterns that are influenced by diverse factors such as location, user behavior, and temporal variations. In this paper, we propose a novel prediction model based on deep learning techniques. Specifically, we develop a customized temporal fusion transformer (TFT) for accurate time series prediction that effectively captures the complex dependencies in mobile network traffic and ensures resilience to unexpected variations, which is critical for efficient network management and QoE enhancement. The prediction model is evaluated and tested against state-of-the-art prediction models using real-world cellular network data as the training dataset. The experimental results validate the excellence of this customized transformer architecture in capturing the complex temporal dynamics of cellular network traffic by exploiting attention-based mechanisms.

References

1. Ericsson, "Ericsson Mobility Report," Jun. 2021.
2. W. Long, R. Chen, M. Moretti, W. Zhang, and J. Li, “A Promising Technology for 6G Wireless Networks: Intelligent Reflecting Surface,” Journal of Communications and Information Networks, vol. 6, no. 1, pp. 1–16, Mar. 2021.
3. L. Li, Y. Zhao, J. Wang, and C. Zhang, “Wireless Traffic Prediction Based on a Gradient Similarity Federated Aggregation Algorithm,” Applied Sciences, vol. 13, no. 6, p. 4036, Jan. 2023.
4. W. Wang, C. Zhou, H. He, W. Wu, W. Zhuang, and X. Shen, “Cellular Traffic Load Prediction with LSTM and Gaussian Process Regression,” in ICC 2020 - 2020 IEEE International Conference on Communications (ICC), Jun. 2020, pp. 1–6.
5. R. Li et al., “Intelligent 5G: When Cellular Networks Meet Artificial Intelligence,” IEEE Wireless Communications, vol. 24, no. 5, pp. 175–183, Oct. 2017.
6. A. D’Alconzo, A. Coluccia, F. Ricciato, and P. Romirer-Maierhofer, “A Distribution-Based Approach to Anomaly Detection and Application to 3G Mobile Traffic,” in GLOBECOM 2009 - 2009 IEEE Global Telecommunications Conference, Nov. 2009, pp. 1–8.
7. T. Tokunaga and K. Mizutani, “A Comprehensive Evaluation of Generating a Mobile Traffic Data Scheme without a Coarse-Grained Process Using CSR-GAN,” Sensors, vol. 22, no. 5, p. 1930, Jan. 2022.
8. C. Zhang, H. Zhang, D. Yuan, and M. Zhang, “Citywide Cellular Traffic Prediction Based on Densely Connected Convolutional Neural Networks,” IEEE Communications Letters, vol. 22, no. 8, pp. 1656–1659, Aug. 2018.
9. C. Zhang, P. Patras, and H. Haddadi, “Deep Learning in Mobile and Wireless Networking: A Survey,” IEEE Communications Surveys & Tutorials, vol. 21, no. 3, pp. 2224–2287, 2019.
10. N. Kato, B. Mao, F. Tang, Y. Kawamoto, and J. Liu, “Ten Challenges in Advancing Machine Learning Technologies toward 6G,” IEEE Wireless Communications, vol. 27, no. 3, pp. 96–103, Jun. 2020.
11. S. F. Stefenon, L. O. Seman, L. S. A. da Silva, V. C. Mariani, and L. dos S. Coelho, “Hypertuned temporal fusion transformer for multi-horizon time series forecasting of dam level in hydroelectric power plants,” International Journal of Electrical Power & Energy Systems, vol. 157, p. 109876, Jun. 2024.
12. S. Huang et al., “MEAformer: An all-MLP transformer with temporal external attention for long-term time series forecasting,” Information Sciences, vol. 669, p. 120605, May 2024.
13. Y. Yu, R. Ma, and Z. Ma, “Robformer: A robust decomposition transformer for long-term time series forecasting,” Pattern Recognition, vol. 153, p. 110552, Sep. 2024.
14. C. Yang, Y. Wang, B. Yang, and J. Chen, “GRAformer: A gated residual attention transformer for multivariate time series forecasting,” Neurocomputing, vol. 581, p. 127466, May 2024.
15. L. de Azevedo Takara, A. C. Teixeira, H. Yazdanpanah, V. C. Mariani, and L. dos Santos Coelho, “Optimizing multi-step wind power forecasting: Integrating advanced deep neural networks with stacking-based probabilistic learning,” Applied Energy, vol. 369, p. 123487, Sep. 2024.
16. J. Wan, N. Xia, Y. Yin, X. Pan, J. Hu, and J. Yi, “TCDformer: A transformer framework for non-stationary time series forecasting based on trend and change-point detection,” Neural Networks, vol. 173, p. 106196, May 2024.
17. B. Lim, S. Ö. Arık, N. Loeff, and T. Pfister, “Temporal Fusion Transformers for interpretable multi-horizon time series forecasting,” International Journal of Forecasting, vol. 37, no. 4, pp. 1748–1764, Oct. 2021.
18. S. Zhan et al., “Cell Traffic Prediction Based on Convolutional Neural Network for Software-Defined Ultra-Dense Visible Light Communication Networks,” Security and Communication Networks, vol. 2021, pp. 1-10, Aug. 2021.
19. F. W. Alsaade and M. Hmoud Al-Adhaileh, “Cellular Traffic Prediction Based on an Intelligent Model,” Mobile Information Systems, vol. 2021, pp. 1-15, Aug. 2021.
20. S. H.s and C. B.m, “Cellular Traffic Prediction through Multi-Layer Hybrid Network Domain,” Mathematical Statistician and Engineering Applications, vol. 71, no. 4, pp. 6189–6201, Nov. 2022.
21. L. Chen, D. Yang, D. Zhang, C. Wang, J. Li, and T.-M.-T. Nguyen, “Deep mobile traffic forecast and complementary base station clustering for C-RAN optimization,” Journal of Network and Computer Applications, vol. 121, pp. 59–69, Nov. 2018.
22. X. Sun, B. Wei, J. Gao, D. Cao, Z. Li and Y. Li, "Spatio-Temporal Cellular Network Traffic Prediction Using Multi-Task Deep Learning for AI-Enabled 6G," Journal of Beijing Institute of Technology, vol. 31, no. 5, pp. 441-453, 2022.
23. S. Moghadas, C. Fiandrino, A. Collet, G. Attanasio, M. Fiore, and J. Widmer, “Spotting Deep Neural Network Vulnerabilities in Mobile Traffic Forecasting with an Explainable AI Lens,” in IEEE INFOCOM 2023 - IEEE Conference on Computer Communications, May 2023, pp. 1–10.
24. J. Feng, X. Chen, R. Gao, M. Zeng, and Y. Li, “DeepTP: An End-to-End Neural Network for Mobile Cellular Traffic Prediction,” IEEE Network, vol. 32, no. 6, pp. 108–115, Nov. 2018.
25. S. Jaffry and S. F. Hasan, “Cellular Traffic Prediction using Recurrent Neural Networks,” in 2020 IEEE 5th International Symposium on Telecommunication Technologies (ISTT), Nov. 2020, pp. 94–98.
26. V. S. Dommaraju et al., “ECMCRR-MPDNL for Cellular Network Traffic Prediction With Big Data,” IEEE Access, vol. 8, pp. 113419–113428, 2020.
27. Q. Zeng, Q. Sun, G. Chen, H. Duan, C. Li, and G. Song, “Traffic Prediction of Wireless Cellular Networks Based on Deep Transfer Learning and Cross-Domain Data,” IEEE Access, vol. 8, pp. 172387–172397, 2020.
28. B. Gu, J. Zhan, S. Gong, W. Liu, Z. Su, and M. Guizani, “A Spatial-Temporal Transformer Network for City-Level Cellular Traffic Analysis and Prediction,” IEEE Transactions on Wireless Communications, vol. 22, no. 12, pp. 9412–9423, Dec. 2023.
29. Q. Liu, J. Li, and Z. Lu, “ST-Tran: Spatial-Temporal Transformer for Cellular Traffic Prediction,” IEEE Communications Letters, vol. 25, no. 10, pp. 3325–3329, Oct. 2021, doi: 10.1109/LCOMM.2021.3098557.
30. I. Guarino, G. Aceto, D. Ciuonzo, A. Montieri, V. Persico, and A. Pescapè, “Explainable Deep-Learning Approaches for Packet-Level Traffic Prediction of Collaboration and Communication Mobile Apps,” IEEE Open Journal of the Communications Society, vol. 5, pp. 1299–1324, 2024.
31. L. Xu et al., “TransMUSE: Transferable Traffic Prediction in MUltiService Edge Networks,” Computer Networks, vol. 221, p. 109518, Feb. 2023.
32. Y. Fang, S. Ergüt, and P. Patras, “SDGNet: A Handover-Aware Spatiotemporal Graph Neural Network for Mobile Traffic Forecasting,” IEEE Communications Letters, vol. 26, no. 3, pp. 582–586, Mar. 2022.
33. A. Montieri, G. Bovenzi, G. Aceto, D. Ciuonzo, V. Persico, and A. Pescapè, “Packet-level prediction of mobile-app traffic using multitask Deep Learning,” Computer Networks, vol. 200, p. 108529, Dec. 2021.
34. P. Kaushik, S. Singh, and P. Yadav, “Traffic Prediction in Telecom Systems Using Deep Learning,” in 2018 7th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO), Aug. 2018, pp. 302–307.
35. Z. Gao, “5G Traffic Prediction Based on Deep Learning,” Computational Intelligence and Neuroscience, vol. 2022, Jun. 2022.
36. G. Feng, L. Zhang, F. Ai, Y. Zhang, and Y. Hou, “An Improved Temporal Fusion Transformers Model for Predicting Supply Air Temperature in High-Speed Railway Carriages,” Entropy, vol. 24, no. 8, p. 1111, Aug. 2022.
37. G. O. Ferreira, C. Ravazzi, F. Dabbene, G. C. Calafiore, and M. Fiore, “Forecasting Network Traffic: A Survey and Tutorial With Open-Source Comparative Evaluation,” IEEE Access, vol. 11, pp. 6018–6044, 2023.
38. D. Bega, M. Gramaglia, M. Fiore, A. Banchs, and X. Costa-Perez, “DeepCog: Cognitive Network Management in Sliced 5G Networks with Deep Learning,” in IEEE INFOCOM 2019 - IEEE Conference on Computer Communications, Apr. 2019, pp. 280–288.
39. D.-A. Clevert, T. Unterthiner and S. Hochreiter, "Fast and accurate deep network learning by exponential linear units (elus)," [Online]. Available: https://arxiv.org/abs/1511.07289, Nov. 2015.
40. J. L. Ba, J. R. Kiros and G. E. Hinton, "Layer Normalization," [Online]. Available: https://arxiv.org/abs/1607.06450, Jul. 2016.
41. S. Li, X. Jin, Y. Xuan, X. Zhou, W. Chen, Y.-X. Wang and X. Yan, "Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting," in Proc. of the 33rd Conf. on Neural Information Processing Systems (NeurIPS 2019), Vancouver, Canada, Dec. 8-14, 2019.
42. A. Vaswani et al., "Attention is all you need," in Proc. of the 31st Conf. on Neural Information Processing Systems (NeurIPS 2017), Long Beach, California, USA, Dec. 4-9, 2017.
43. R. Wen, K. Torkkola, B. Narayanaswamy, and D. Madeka, "A Multi-Horizon Quantile Recurrent Forecaster," [Online]. Available: https://arxiv.org/abs/1711.11053, Jun, 2018.
44. G. Barlacchi et al., “A multi-source dataset of urban life in the city of Milan and the Province of Trentino,” Sci Data, vol. 2, no. 1, p. 150055, Oct. 2015.
45. R. J. Hyndman and A. B. Koehler, “Another look at measures of forecast accuracy,” International Journal of Forecasting, vol. 22, no. 4, pp. 679–688, Oct. 2006.

Issue

Copyright Institute of Electrical and Electronics Engineers Inc.