Performance Test of Spacex’s Starlink: An Empirical Review

OMOROGIUWA, OSEMWEGIE; Bello, Nosa; Akhihiero, Victor; Akpala, Somto

doi:10.21608/jesaun.2024.300081.1347

Performance Test of Spacex’s Starlink: An Empirical Review

Document Type : Review Paper

Authors

Electrical and Electronics Engineering Dept., University of Benin, Benin City, Nigeria.

10.21608/jesaun.2024.300081.1347

Abstract

In recent years, there has been significant interest in the deployment of Low Earth Orbit (LEO) satellite constellations as a potential solution to provide broadband internet access to remote regions [1]. One such constellation, Starlink, run by SpaceX, promises fast internet connectivity via its constellation of satellites in low Earth orbit. In this study, a comprehensive analysis of Starlink’s performance in Nigeria was given, assessing five performance metrics: latency, packet loss, throughput, routing strategy, and environmental influences. The tests were conducted for the various metrics using command-line tools like Ping (Packet Internet or Inter-Network Groper), tracert (traceroute), iperf3 (Internet Performance Working Group), and Python scripts which were used to both automating the test procedures and analysing the collected data. Our findings reveal that Starlink’s latency was higher than advertised but still low compared to most Mobile Network Operators (MNOs) in Nigeria, making it suitable for the majority of internet users. On average, the study found that packet loss remained relatively low, jitter was within acceptable limits, and throughput exhibited variations but generally maintained satisfactory levels. Also, heavy rainfall was found to affect Starlink’s performance, highlighting the impact of environmental factors.

Keywords

Main Subjects

Electrical Engineering, Computer Engineering and Electrical power and machines engineering.

References

[1] T. Ahmmed, A. Alidadi, Z. Zhang, A. U. Chaudhry, and H. Yanikomeroglu, “The digital divide in canada and the role of leo satellites in bridging the gap,” IEEE Communications Magazine, vol. 60, no. 6, pp. 24–30, 2022.

[2] L. Townsend, A. Sathiaseelan, G. Fairhurst, and C. Wallace, “Enhanced broadband access as a solution to the social and economic problems of the rural digital divide,” Local Economy, vol. 28, no. 6, pp. 580–595, 2013. [Online]. Available: https://doi.org/10.1177/0269094213496974

[3] D. M. West, “Digital divide: Improving internet access in the developing world through affordable services and diverse content,” Center for Technology Innovation at Brookings, pp. 1–30, 2015.

[4] John Garrity and Arndt Husar, for. The A., 2021. Digital Connectivity and Low Earth Orbit Satellite Constellations: Opportunities for Asia and the Pacific (SDWP No. 76, Asian Development Bank Institute, ADB Sustainable Development Working Paper Series)

[5] A. Lalbakhsh, A. Pitcairn, K. Mandal, M. Alibakhshikenari, K. P. Esselle, and S. Reisenfeld, “Darkening low-earth orbit satellite constellations: A review,” IEEE Access, vol. 10, pp. 24 383–24 394, 2022.

[6] M. D. Patrick, A Brief History of Digital Communications. Cham: Springer International Publishing, 2019, pp. 23–47. [Online]. Available: https://doi.org/10.1007/978-3-030-14439-5 2

[7] B. M. Leiner, V. G. Cerf, D. D. Clark, R. E. Kahn, L. Kleinrock, D. C. Lynch, J. Postel, L. G. Roberts, and S. S. Wolff, “The past and future history of the internet,” Communications of the ACM, vol. 40, no. 2, 1997.

[8] G. Giuliari, T. Ciussani, A. Perrig, and A. Singla, “{ICARUS}: Attacking low earth orbit satellite networks,” in 2021 USENIX Annual Technical Conference (USENIX ATC 21), 2021, pp. 317– 331.

[9] T. Pfandzelter and D. Bermbach, “Edge (of the earth) replication: Optimizing content delivery in large Leo satellite communication networks,” in 2021 IEEE/ACM 21st International Symposium on Cluster, Cloud and Internet Computing (CCGrid). IEEE, 2021, pp. 565–575.

[10] A. A. Bisu, A. Purvis, K. Brigham, and H. Sun, “A framework for end-to-end latency measurements in a satellite network environment,” in 2018 IEEE International Conference on Communications (ICC), 2018, pp. 1–6.

[11] G. Pan, J. Ye, J. An and M. -S. Alouini, "Latency Versus Reliability in LEO Mega-Constellations: Terrestrial, Aerial, or Space Relay?," in IEEE Transactions on Mobile Computing, vol. 22, no. 9, pp. 5330-5345, 1 Sep. 2023, doi: 10.1109/TMC.2022.3168081.

[12] I.Bilogrevic, “Satellite communications: Internet challenges and low-latency applications,” 2008. [Online]. Available: http: //infoscience.epfl.ch/record/147212

[13] F. Michel, M. Trevisan, D. Giordano, and O. Bonaventure, “A first look at starlink 9 performance,” in Proceedings of the 22nd ACM Internet Measurement Conference, ser. IMC ’22. New York, NY, USA: Association for Computing Machinery, 2022, p. 130–136. [Online]. Available: https://doi.org/10.1145/3517745.3561416

[14] M. M. Kassem, A. Raman, D. Perino, and N. Sastry, “A browser-side view of starlink connectivity,” in Proceedings of the 22nd ACM Internet Measurement Conference, ser. IMC ’22. New York, NY, USA: Association for Computing Machinery, 2022, p. 151–158. [Online]. Available: https://doi.org/10.1145/3517745.3561457

[15] A. Raman, M. Varvello, H. Chang, N. Sastry, and Y. Zaki, “Dissecting the performance of satellite network operators,” Proc. ACM Netw., vol. 1, no. CoNEXT3, Nov 2023. [Online]. Available: https://doi.org/10.1145/3629137

[16] S. Ma, Y. C. Chou, H. Zhao, L. Chen, X. Ma, and J. Liu, “Network characteristics of leo satellite constellations: A starlink-based measurement from end users,” 2022. [Online]. Available: https://arxiv.org/pdf/2212.13697. Pdf

[17] N. Mohan, A. Ferguson, H. Cech, R. Bose, P. Renatin, M. Marina, and J. Ott, “A multifaceted look at starlink performance,” in WWW ’24: Proceedings of the ACM Web Conference 2024. ACM, Jan. 2024, pp. 1–12, wWW ’24: The ACM Web Conference 2024; Conference date: 13-05- 2024 through 17-05-2024. [Online]. Available: https://www2024.thewebconf.org

[18] M. Rajiullah, G. Caso, A. Brunstrom, J. Karlsson, S. Alfredsson, and O. Alay, “Carl-w: a testbed for empirical analyses of 5g and starlink performance,” 11 2023.

[19] R. Z. Pearlman. (2024) Spacex launches starlink satellites on record 20th reflight of a falcon 9 rocket first stage. [Online]. Available: https://www.space.com/ spacex-falcon-9-20th-launch-starlink-group-6-49

[20] M. Wall. (2024) Spacex launching 23 starlink satellites from Florida this evening. [Online]. Available: https://www.space.com/

[21] S. Ma, Y. C. Chou, H. Zhao, L. Chen, X. Ma, and J. Liu, “Network characteristics of leo satellite constellations: A starlink-based measurement from end users,” in IEEE INFOCOM 2023- IEEE Conference on Computer Communications. IEEE, 2023, pp. 1–10.

[22] A. U. Chaudhry and H. Yanikomeroglu, “Free space optics for next-generation satellite networks,” IEEE Consumer Electronics Magazine, vol. 10, no. 6, pp. 21–31, 2020.

[23] S. Insider, “Starlink ground station locations: An overview,” 2024. [Online]. Available: https://starlinkinsider.com/ starlink-gateway-locations/

[24] Profitap. (2024, January) Latency vs. jitter: Monitoring network performance. IOTA. [Online]. Available: https://insights.profitap.com/latency-vs. -Jitter-monitoring-network-performance

[25] Kentik, “Understanding latency, packet loss, and jitter in network performance,” https://www.kentik.com/kentipedia/ understanding-latency-packet-loss-and-jitter-in-networking/, 2024.

[26] U. Ekpe, V. Umoh, and U. Ukommi, “A comparative study of user experienced mobile broadband performance,” Nigerian Journal of Technology, vol. 41, 07 2022.

[27] RingCentral, “What is jitter? How to test and reduce internet jitter,” 2022. [Online]. Available: https://www.ringcentral. Com/us/en/blog/what-is-jitter/? BMID= ORGSOCIALBLOGURL

[28] X. Qi, B. Zhang, and Z. Qi, “A Distributed Survivable Routing Algorithm for Mega-Constellations with Inclined Orbits,” IEEE Access, vol. 8, pp. 219199–219213, 2020, doi: https://doi.org/10.1109/access.2020.304134.

[29] Rdw8021, “Starlink Ground Station Warren County Missouri,” Reddit, Jun. 13, 2021. Available: https://www.reddit.com/r/Starlink/comments/nz79au/starlink_ground_station_warren_county_missouri/#lightbox. [Accessed: Jul. 24, 2024]