Energy Aware Deep Reinforcement Learning Scheduling for Sensors Correlated in Time and Space

Jernej Hribar, Andrei Marinescu, Alessandro Chiumento, Luiz A. DaSilva

Research output: Contribution to journalArticleAcademicpeer-review

8 Citations (Scopus)
62 Downloads (Pure)


Millions of battery-powered sensors deployed for monitoring purposes in a multitude of scenarios, e.g., agriculture, smart cities, industry, etc., require energy-efficient solutions to prolong their lifetime. When these sensors observe a phenomenon distributed in space and evolving in time, it is expected that collected observations will be correlated in time and space. This paper proposes a () based scheduling mechanism capable of taking advantage of correlated information. The designed solution employs () algorithm. The proposed mechanism can determine the frequency with which sensors should transmit their updates, to ensure accurate collection of observations, while simultaneously considering the energy available. The solution is evaluated with multiple datasets containing environmental observations obtained in multiple real deployments. The real observations are leveraged to model the environment with which the mechanism interacts as realistically as possible. The proposed solution can significantly extend the sensors’ lifetime and is compared to an idealized, all-knowing scheduler to demonstrate that its performance is near-optimal. Additionally, the results highlight the unique feature of proposed design, energy-awareness, by displaying the impact of sensors’ energy levels on the frequency of updates.
Original languageEnglish
Pages (from-to)6732-6744
Number of pages1
JournalIEEE Internet of Things Journal
Issue number9
Early online date21 Sept 2021
Publication statusPublished - May 2022


  • Sensor systems
  • Intelligent sensors
  • Sensor phenomena and characterization
  • Internet of Things
  • Job shop scheduling
  • Logic gates
  • Reinforcement learning
  • 22/2 OA procedure


Dive into the research topics of 'Energy Aware Deep Reinforcement Learning Scheduling for Sensors Correlated in Time and Space'. Together they form a unique fingerprint.

Cite this