A Framework to Measure Reliance of Acoustic Latency on Smartphone Status

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Abstract

Audio latency, defined as the time duration when an audio signal travels from the microphone to an app or from an app to the speakers, significantly influences the performance of many mobile sensing applications including acoustic based localization and speech recognition. It is well known within the mobile app development community that audio latencies can be significant (up to hundreds of milliseconds) and vary from smartphone to smartphone and from time to time. Therefore, it is essential to study the causes and effects of the audio latency in smartphones. To the best of our knowledge, there exist mobile apps that can measure audio latency but not the corresponding status of smartphones such as available RAM, CPU loads, battery level, and number of files and folders. In this paper, we are the first to propose a framework that can simultaneously log both the audio latency and the status of smartphones. The proposed framework does not require time synchronization or firmware reprogramming and can run on a standalone device. Since the framework is designed to study the latency causality, the status of smartphones are deliberately and randomly varied as maximum as possible. To evaluate the framework, we present a case study with Android devices. We design and implement a latency app that simultaneously measures the latency and the status of smartphones. The preliminary results show that the latency values have large means (50 - 150 ms) and variances (4-40 ms). The effect of latency can be considerably reduced by just simply subtracting the offset. In order to achieve improved latency prediction that can cope with the variances an advanced regression model would be preferred.

Original languageEnglish
Title of host publication2018 IEEE International Conference on Pervasive Computing and Communications Workshops, PerCom Workshops 2018
PublisherIEEE
Pages348-354
Number of pages7
ISBN (Electronic)978-1-5386-3227-7, 978-1-5386-3226-0
ISBN (Print)978-1-5386-3228-4
DOIs
Publication statusE-pub ahead of print/First online - 8 Oct 2018
Event2018 IEEE International Conference on Pervasive Computing and Communications 2018 - Athens, Greece
Duration: 19 Mar 201823 Mar 2018

Conference

Conference2018 IEEE International Conference on Pervasive Computing and Communications 2018
Abbreviated titlePerCOM 2018
CountryGreece
CityAthens
Period19/03/1823/03/18

Fingerprint

Smartphones
Acoustics
Application programs
Firmware
Random access storage
Microphones
Speech recognition
Program processors
Synchronization

Cite this

Le, D. V., Kamminga, J., Scholten, H., & Havinga, P. J. M. (2018). A Framework to Measure Reliance of Acoustic Latency on Smartphone Status. In 2018 IEEE International Conference on Pervasive Computing and Communications Workshops, PerCom Workshops 2018 (pp. 348-354). [8480354] IEEE. https://doi.org/10.1109/PERCOMW.2018.8480354
Le, Duc V. ; Kamminga, Jacob ; Scholten, Hans ; Havinga, Paul J.M. / A Framework to Measure Reliance of Acoustic Latency on Smartphone Status. 2018 IEEE International Conference on Pervasive Computing and Communications Workshops, PerCom Workshops 2018. IEEE, 2018. pp. 348-354
@inproceedings{2d9d536c616c41958ffdfd14d34eaf05,
title = "A Framework to Measure Reliance of Acoustic Latency on Smartphone Status",
abstract = "Audio latency, defined as the time duration when an audio signal travels from the microphone to an app or from an app to the speakers, significantly influences the performance of many mobile sensing applications including acoustic based localization and speech recognition. It is well known within the mobile app development community that audio latencies can be significant (up to hundreds of milliseconds) and vary from smartphone to smartphone and from time to time. Therefore, it is essential to study the causes and effects of the audio latency in smartphones. To the best of our knowledge, there exist mobile apps that can measure audio latency but not the corresponding status of smartphones such as available RAM, CPU loads, battery level, and number of files and folders. In this paper, we are the first to propose a framework that can simultaneously log both the audio latency and the status of smartphones. The proposed framework does not require time synchronization or firmware reprogramming and can run on a standalone device. Since the framework is designed to study the latency causality, the status of smartphones are deliberately and randomly varied as maximum as possible. To evaluate the framework, we present a case study with Android devices. We design and implement a latency app that simultaneously measures the latency and the status of smartphones. The preliminary results show that the latency values have large means (50 - 150 ms) and variances (4-40 ms). The effect of latency can be considerably reduced by just simply subtracting the offset. In order to achieve improved latency prediction that can cope with the variances an advanced regression model would be preferred.",
author = "Le, {Duc V.} and Jacob Kamminga and Hans Scholten and Havinga, {Paul J.M.}",
year = "2018",
month = "10",
day = "8",
doi = "10.1109/PERCOMW.2018.8480354",
language = "English",
isbn = "978-1-5386-3228-4",
pages = "348--354",
booktitle = "2018 IEEE International Conference on Pervasive Computing and Communications Workshops, PerCom Workshops 2018",
publisher = "IEEE",
address = "United States",

}

Le, DV, Kamminga, J, Scholten, H & Havinga, PJM 2018, A Framework to Measure Reliance of Acoustic Latency on Smartphone Status. in 2018 IEEE International Conference on Pervasive Computing and Communications Workshops, PerCom Workshops 2018., 8480354, IEEE, pp. 348-354, 2018 IEEE International Conference on Pervasive Computing and Communications 2018, Athens, Greece, 19/03/18. https://doi.org/10.1109/PERCOMW.2018.8480354

A Framework to Measure Reliance of Acoustic Latency on Smartphone Status. / Le, Duc V.; Kamminga, Jacob; Scholten, Hans; Havinga, Paul J.M.

2018 IEEE International Conference on Pervasive Computing and Communications Workshops, PerCom Workshops 2018. IEEE, 2018. p. 348-354 8480354.

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - A Framework to Measure Reliance of Acoustic Latency on Smartphone Status

AU - Le, Duc V.

AU - Kamminga, Jacob

AU - Scholten, Hans

AU - Havinga, Paul J.M.

PY - 2018/10/8

Y1 - 2018/10/8

N2 - Audio latency, defined as the time duration when an audio signal travels from the microphone to an app or from an app to the speakers, significantly influences the performance of many mobile sensing applications including acoustic based localization and speech recognition. It is well known within the mobile app development community that audio latencies can be significant (up to hundreds of milliseconds) and vary from smartphone to smartphone and from time to time. Therefore, it is essential to study the causes and effects of the audio latency in smartphones. To the best of our knowledge, there exist mobile apps that can measure audio latency but not the corresponding status of smartphones such as available RAM, CPU loads, battery level, and number of files and folders. In this paper, we are the first to propose a framework that can simultaneously log both the audio latency and the status of smartphones. The proposed framework does not require time synchronization or firmware reprogramming and can run on a standalone device. Since the framework is designed to study the latency causality, the status of smartphones are deliberately and randomly varied as maximum as possible. To evaluate the framework, we present a case study with Android devices. We design and implement a latency app that simultaneously measures the latency and the status of smartphones. The preliminary results show that the latency values have large means (50 - 150 ms) and variances (4-40 ms). The effect of latency can be considerably reduced by just simply subtracting the offset. In order to achieve improved latency prediction that can cope with the variances an advanced regression model would be preferred.

AB - Audio latency, defined as the time duration when an audio signal travels from the microphone to an app or from an app to the speakers, significantly influences the performance of many mobile sensing applications including acoustic based localization and speech recognition. It is well known within the mobile app development community that audio latencies can be significant (up to hundreds of milliseconds) and vary from smartphone to smartphone and from time to time. Therefore, it is essential to study the causes and effects of the audio latency in smartphones. To the best of our knowledge, there exist mobile apps that can measure audio latency but not the corresponding status of smartphones such as available RAM, CPU loads, battery level, and number of files and folders. In this paper, we are the first to propose a framework that can simultaneously log both the audio latency and the status of smartphones. The proposed framework does not require time synchronization or firmware reprogramming and can run on a standalone device. Since the framework is designed to study the latency causality, the status of smartphones are deliberately and randomly varied as maximum as possible. To evaluate the framework, we present a case study with Android devices. We design and implement a latency app that simultaneously measures the latency and the status of smartphones. The preliminary results show that the latency values have large means (50 - 150 ms) and variances (4-40 ms). The effect of latency can be considerably reduced by just simply subtracting the offset. In order to achieve improved latency prediction that can cope with the variances an advanced regression model would be preferred.

UR - http://www.scopus.com/inward/record.url?scp=85056451490&partnerID=8YFLogxK

U2 - 10.1109/PERCOMW.2018.8480354

DO - 10.1109/PERCOMW.2018.8480354

M3 - Conference contribution

SN - 978-1-5386-3228-4

SP - 348

EP - 354

BT - 2018 IEEE International Conference on Pervasive Computing and Communications Workshops, PerCom Workshops 2018

PB - IEEE

ER -

Le DV, Kamminga J, Scholten H, Havinga PJM. A Framework to Measure Reliance of Acoustic Latency on Smartphone Status. In 2018 IEEE International Conference on Pervasive Computing and Communications Workshops, PerCom Workshops 2018. IEEE. 2018. p. 348-354. 8480354 https://doi.org/10.1109/PERCOMW.2018.8480354