tuzsutТруды учебных заведений связиProceedings of Telecommunication Universities1813-324X2712-8830СПбГУТ10.31854/1813-324X-2023-9-1-59-73tuzsut-440Research ArticleЭЛЕКТРОНИКА, ФОТОНИКА, ПРИБОРОСТРОЕНИЕ И СВЯЗЬELECTRONICS, PHOTONICS, INSTRUMENTATION AND COMMUNICATIONSТестирование облачных систем видеоконференцсвязи на основе параметра ХёрстаAnalysis of Experience Quality Parameters of Cloud Video Conferencing Systems under Interference Conditionshttps://orcid.org/0000-0002-8781-6840КиричекР. В.KirichekR.

доктор технических наук, доцент, ректор Санкт-Петербургского государственного университета телекоммуникаций им. проф. М.А. Бонч-Бруевича

St. Petersburg, Russian Federation

kirichek@sut.ruhttps://orcid.org/0000-0002-1748-8642БерёзкинА. А.BerezkinA.

кандидат технических наук, доцент кафедры программной инженерии и вычислительной техники Санкт-Петербургского государственного университета телекоммуникаций им. проф. М.А. Бонч-Бруевича

St. Petersburg, Russian Federation

berezkin.aa@sut.ruhttps://orcid.org/0000-0002-2674-5217КукунинД. С.KukuninD.

кандидат технических наук, доцент кафедры сетей связи и передачи данных Санкт-Петербургского государственного университета телекоммуникаций им. проф. М.А. Бонч-Бруевича

St. Petersburg, Russian Federation

kukunin.ds@sut.ruhttps://orcid.org/0009-0000-8401-8723КолесниковА. В.KolesnikovA.

директор Ассоциации участников рынка интернета вещей

Moscow, Russian Federation

andrei@iotas.ruСанкт-Петербургский государственный университет телекоммуникаций им. М.А. Бонч-БруевичаРоссияThe Bonch-Bruevich Saint-Petersburg State University of TelecommunicationsRussian FederationАссоциация участников рынка интернета вещейРоссияAssociation of Internet of Things Market ParticipantsRussian Federation202310032023915973Copyright © Киричек Р.В., Берёзкин А.А., Кукунин Д.С., Колесников А.В., 20232023Киричек Р.В., Берёзкин А.А., Кукунин Д.С., Колесников А.В.Kirichek R., Berezkin A., Kukunin D., Kolesnikov A.This work is licensed under a Creative Commons Attribution 4.0 License.https://tuzs.sut.ru/jour/article/view/440

В статье рассматриваются вопросы тестирования популярных отечественных и зарубежных облачных систем видеоконференцсвязи (ВКС). Предложена методика тестирования и сравнения качественных параметров приложений ВКС на основе международного опыта. Оценка и сравнение услуг ВКС выполнены на основе вычисления параметра Хёрста потоков данных, формируемых исследуемыми облачными системами ВКС. Проведено тестирование различных приложений зарубежных и отечественных систем ВКС в различных режимах работы при разных параметрах качества канала связи.

The article deals with the testing of popular domestic and foreign cloud videoconferencing systems. A methodology for testing and comparing qualitative parameters of videoconferencing applications based on international experience is proposed. Assessment and comparison of videoconferencing services is based on the calculation of Hurst data flows, formed by the investigated cloud videoconferencing systems. Various applications of foreign and domestic videoconferencing systems have been tested in different operation modes with different channel quality parameters.

качество восприятиявидеоконференцсвязьпараметр ХёрстаDIONZoomTrueConfWebinar meetingsCisco WebExMicrosoft TeamsDiscordquality of experiencevideo conferencingHurst parameterDIONZoomTrueConfWebinar meetingsCisco WebExMicrosoft TeamsDiscordReferencesRec. ITU-T Q.3949 (08/2012). Real-time multimedia service testing framework at the user-to-network interface of next generation networks.Rec. ITU-T Q.3949. Real-time multimedia service testing framework at the user-to-network interface of next generation networks. December 2012.Грачева М.А., Божкова В.П., Казакова А.А., Рожкова Г.И. Субъективная оценка качества статических и видео-изображений: методологический обзор // Сенсорные системы. 2019. Т. 33. № 4. C. 287‒304.Gracheva M.A., Bozhkovaa V.P., Kazakovaa A.A. Rozhkovaa G.I. Subjective image and video quality assessment: methodology review. Sensornye seti. 2019; 33(4):287‒304. (in Russ.)Ahmed M.S. Achieving QoS in media streaming for peer to peer networks // International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT, Chennai, India, 2016). 2016. PP. 3694–3698. DOI:10.1109/ICEEOT.2016.7755399Ahmed M.S. Achieving QoS in media streaming for peer to peer networks. 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT). Chennai, India; 2016. pp. 3694–3698. DOI:10.1109/ICEEOT.2016. 7755399.Bao Y., Lei W., Zhang W., Song J. HD streaming media QoE quantitative evaluation model for multipath transmission // 11th International Conference on Computer Science & Education (ICCSE, Nagoya, Japan, 2016). 2016. PP. 658–665. DOI:10.1109/ICCSE.2016.7581658.Bao Y., Lei W., Zhang W., Song J. HD streaming media QoE quantitative evaluation model for multipath transmission. 2016 11th International Conference on Computer Science & Education (ICCSE), Nagoya, Japan. 2016. pp. 658–665. DOI:10.1109/ICCSE.2016.7581658.Fowdur T.P., Narrainen L. Enhanced video streaming using dynamic quality control with bandwidth prediction // International Conference on Computer as a Tool (EUROCON, Salamanca, Spain, 2015). 2015. PP. 1–6. DOI:10.1109/EUROCON.2015.7313675Fowdur T.P., Narrainen L. Enhanced video streaming using dynamic quality control with bandwidth prediction IEEE EUROCON 2015 ‒International Conference on Computer as a Tool (EUROCON), Salamanca, Spain. 2015. pp. 1–6. DOI:10.1109/ EUROCON.2015.7313675.Taraghi B., Nguyen M., Amirpour H., Timmerer C. Intense: In-Depth Studies on Stall Events and Quality Switches and Their Impact on the Quality of Experience in HTTP Adaptive Streaming. IEEE, 2021. Vol. 9. PP. 118087–118098. DOI:10.1109/ACCESS.2021.3107619Taraghi B., Nguyen M., Amirpour H., Timmerer C. Intense: In-Depth Studies on Stall Events and Quality Switches and Their Impact on the Quality of Experience in HTTP Adaptive Streaming. IEEE. 2021. vol. 9. pp. 118087–118098. DOI:10.1109/ACCESS.2021.3107619Yeganeh H., Qassemi F., Rabiee H.R. Joint effect of stalling and presentation quality on the quality-of-experience of streaming videos // IEEE International Conference on Image Processing (ICIP, Beijing, China, 2017). 2017. PP. 310–314. DOI:10.1109/ICIP.2017.8296293Yeganeh H., Qassemi F., Rabiee H.R. Joint effect of stalling and presentation quality on the quality-of-experience of streaming videos. 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China. 2017. pp. 310–314. DOI:10.1109/ICIP.2017.8296293Seufert A., Wamser F., Yarish D., Macdonald H., Hoßfeld T. QoE Models in the Wild: Comparing Video QoE Models Using a Crowdsourced Data Set // 13th International Conference on Quality of Multimedia Experience (QoMEX, Montreal, QC, Canada, 2021). 2021. PP. 55–60. DOI:10.1109/QoMEX51781.2021.9465422Seufert A., Wamser F., Yarish D., Macdonald H., Hoßfeld T. QoE Models in the Wild: Comparing Video QoE Models Using a Crowdsourced Data Set. 2021 13th International Conference on Quality of Multimedia Experience (QoMEX), Montreal, QC, Canada. 2021. pp. 55–60. DOI:10.1109/QoMEX51781.2021.9465422Hoßfeld T., Heegaard P.E., Skorin-Kapov L., Varela M. No silver bullet: QoE metrics, QoE fairness, and user diversity in the context of QoE management // Ninth International Conference on Quality of Multimedia Experience (QoMEX, Erfurt, Germany, 2017). 2017. PP. 1–6. DOI:10.1109/QoMEX.2017.7965671Hoßfeld T., Heegaard P.E., Skorin-Kapov L., Varela M. No silver bullet: QoE metrics, QoE fairness, and user diversity in the context of QoE management. 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX), Erfurt, Germany. 2017. pp. 1–6. DOI:10.1109/QoMEX.2017.7965671Mardian R. D., Suryanegara M., Ramli K. Measuring Quality of Service (QoS) and Quality of Experience (QoE) on 5G Technology: A Review // IEEE International Conference on Innovative Research and Development (ICIRD, Jakarta, Indonesia, 2019). 2019. PP. 1–6, DOI:10.1109/ICIRD47319.2019.9074681Mardian R.D., Suryanegara M., Ramli K. Measuring Quality of Service (QoS) and Quality of Experience (QoE) on 5G Technology: A Review. 2019 IEEE International Conference on Innovative Research and Development (ICIRD), Jakarta, Indonesia. 2019. pp. 1–6. DOI:10.1109/ICIRD47319.2019.9074681Hewage C. T. E. R., Ahmad A., Mallikarachchi T., Barman N., Martini M. G. Measuring, Modeling and Integrating Time-Varying Video Quality in End-to-End Multimedia Service Delivery: A Review and Open Challenges. IEEE. 2022. Vol. 10. PP. 60267–60293. DOI:10.1109/ACCESS.2022.3180491Hewage C.T.E.R., Ahmad A., Mallikarachchi T., Barman N., Martini M.G. Measuring, Modeling and Integrating Time-Varying Video Quality in End-to-End Multimedia Service Delivery: A Review and Open Challenges. IEEE, 2022. vol. 10. pp. 60267–60293. DOI:10.1109/ACCESS.2022.3180491Рекомендация МСЭ-Т G.107 (06.2015). Е-модель – вычислительная модель, используемая при планировании передачи.Rec. ITU-T G.107. International Telephone Connections and Circuits – Transmission Planning and the E-Model. June 2015.Кучерявый, А.Е., Парамонов А.И., Кучерявый Е.А. Сети связи общего пользования. Тенденции развития и методы расчета. М.: ФГУП ЦНИИС, 2008. 296 с.Koucheryavy A., Paramonov A., Koucheryavy E. Public Communication Networks. Development Trends and Calculation Methods. Moscow: Central Research Institute of Communication Publ.; 2008. (in Russ.)Rec. ITU-T G.1011 (07/2016). Reference guide to quality of experience assessment methodologies.Rec. ITU-T G.1011. Reference guide to quality of experience assessment methodologies. June 2016.Шелухин О.И., Осин А.В., Смольский С.М. Самоподобие и фракталы. Телекоммуникационные приложения. М.: Физматлит, 2008.Shelukhin O.I., Osin A.V., Smolsky S.M. Self-Similarity and Fractals. Telecommunication Applications. Moscow: Fizmatlit Publ.; 2008. (in Russ.)Janevski T., Vanevski Z. Statistical Analysis of Multicast versus Instant Channel Changing Unicast IPTV Provisioning // Proceedings of the 16th Telecommunications Forum (TELFOR, Belgrade, Serbia, 25‒27 November 2008). 2008. PP. 96‒99.Janevski T., Vanevski Z. Statistical Analysis of Multicast versus Instant Channel Changing Unicast IPTV Provisioning. Proceedings of the 16th Telecommunications Forum, TELFOR, 25‒27 November 2008, Belgrade, Serbia. 2008. p.96‒99.Paramonov P., Tarasov D., Koucheryavy A. The Video Streaming Monitoring in the Next Generation Network // Proceedings of the 9th International Conference on Next Generation Wired/Wireless Networking (NEW2AN 2009) and Second Conference on on Internet of Things and Smart Spaces (ruSMART 2009), St. Petersburg, Russia, 15‒18 September 2009. Lecture Notes in Computer Science. Vol. 5764. Berlin, Heidelberg: Springer, 2009. PP. 191–205. DOI:10.1007/978-3-642-04190-7_18Paramonov P., Tarasov D., Koucheryavy A. The Video Streaming Monitoring in the Next Generation Network. Proceedings of the 9th International Conference on Next Generation Wired/Wireless Networking, NEW2AN 2009, and Second Conference on on Internet of Things and Smart Spaces, ruSMART 2009, 15‒18 September 2009, St. Petersburg, Russia. Lecture Notes in Computer Science, vol.5764. Berlin, Heidelberg: Springer; 2009. p.191–205. DOI:10.1007/978-3-642-04190-7_18Rezaul K.M., Pakstas A., Gilchrist R., Chen T.M. HEAF: A Novel Estimator for Long-Range Dependent Self-similar Network Traffic // Proceedings of the 6th International Conference on Next Generation Teletraffic and Wired/Wireless Advanced Networking (NEW2AN 2006), St. Petersburg, Russia, 29 May‒2 June 2006. Lecture Notes in Computer Science. Vol. 4003. Berlin, Heidelberg: Springer, 2006. PP. 34–45. DOI:10.1007/11759355_6Rezaul K.M., Pakstas A., Gilchrist R., Chen T.M. HEAF: A Novel Estimator for Long-Range Dependent Self-similar Network Traffic. Proceedings of the 6th International Conference on Next Generation Teletraffic and Wired/Wireless Advanced Networking, NEW2AN 2006, 29 May‒2 June 2006, St. Petersburg, Russia. Lecture Notes in Computer Science, vol.4003. Berlin, Heidelberg: Springer; 2006. p.34–45. DOI:10.1007/11759355_6Маколкина М.А. Взаимосвязь субъективных оценок качества восприятия видео и значений параметра Хёрста // Системы управления и информационные технологии. 2014. 1-1(55). C. 169‒172.Makolkina M.A. The Relationship between Subjective Assessments of the Quality of Video Perception and the Values of the Hurst Parameter. Sistemy upravleniia i informatsionnye tekhnologii. 2014;1-1(55):169‒172. (in Russ.)Маколкина М.А. Учет параметра Хёрста при формировании субъективных оценок качества восприятия видео и значений // Информационные технологии моделирования и управления. 2016. Т. 99. № 3. C. 197‒204.Makolkina M. Parameter Values Hurst in Subjective Evaluations of the Quality of the Relationship of Perception and Video. Informatsionnye tekhnologii modelirovaniia i upravleniia. 2016;99(3):197‒204. (in Russ.)Маколкина М.А. Анализ модели объективной оценки качества передачи видео в IP-сетях // Электросвязь. 2011. № 12. C. 20а‒23.Makolkina M.A. Analysis of the Model for an Objective Assessment of the Quality of Video Transmission in IP Networks. Electrosvyaz. 2011;12:20‒23. (in Russ.)Куликов С. Тестирование программного обеспечения. Базовый курс. EPAM systems, 2015‒2022. URL: https://svyatoslav.biz/software_testing_book_download (дата обращения 09.02.2023)Kulikov S. Software Testing. Basic Course. EPAM systems; 2015‒2022. (in Russ.) URL: https://svyatoslav.biz/software_ testing_book_download [Accessed 9th February 2023]Rec. ITU-T Y.1541 (12/2013). Network performance objectives for IP-based services. Amendment 1: New Appendix XII – Considerations for low speed access networks.Rec. ITU-T Y.1541. Network performance objectives for IP-based services. Amendment 1: New Appendix XII – Considerations for low speed access networks. December 2013.Zoom Patents // Zoom. URL: https://explore.zoom.us/en/trust/patents (дата обращения 09.02.2023)Zoom. Zoom Patents. URL: https://explore.zoom.us/en/trust/patents [Accessed 9th February 2023]

The authors declare that there are no conflicts of interest present.