150306 20251017144548.0 doi 10.1109/JSAC.2015.2391792 sideral 102734 ART-2015-102734 eng Fernandez-Bes, Jesus (orcid)0000-0001-5175-3166 An MDP Model for Censoring in Harvesting Sensors: Optimal and Approximated Solutions 2015 Access copy available to the general public Unrestricted In this paper, we propose a novel censoring policy for energy-efficient transmissions in energy-harvesting sensors. The problem is formulated as an infinite-horizon Markov Decision Process (MDP). The objective to be optimized is the expected sum of the importance (utility) of all transmitted messages. Assuming that such importance can be evaluated at the transmitting node, we show that, under certain conditions on the battery model, the optimal censoring policy is a threshold function on the importance value. Specifically, messages are transmitted only if their importance is above a threshold whose value depends on the battery level. Exploiting this property, we propose a model-based stochastic scheme that approximates the optimal solution, with less computational complexity and faster convergence speed than a conventional Q-learning algorithm. Numerical experiments in single-hop and multi-hop networks confirm the analytical advantages of the proposed scheme. info:eu-repo/semantics/openAccess All rights reserved http://www.europeana.eu/rights/rr-f/ 3.672 2015 TELECOMMUNICATIONS 4 / 82 = 0.049 2015 Q1 T1 ENGINEERING, ELECTRICAL & ELECTRONIC 16 / 255 = 0.063 2015 Q1 T1 2.092 2015 Electrical and Electronic Engineering 2015 Q1 Computer Networks and Communications 2015 Q1 info:eu-repo/semantics/article info:eu-repo/semantics/acceptedVersion Cid-Sueiro, Jesús Marques, Antonio G. 33, 8 (2015), 1717-1729 IEEE j. sel. areas commun. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS 0733-8716 1156266 http://zaguan.unizar.es/record/150306/files/texto_completo.pdf Postprint 3583014 http://zaguan.unizar.es/record/150306/files/texto_completo.jpg?subformat=icon icon Postprint oai:zaguan.unizar.es:150306 articulos driver 2025-10-17-14:10:44 ARTICLE