{"id":2411,"date":"2025-02-20T12:40:46","date_gmt":"2025-02-20T12:40:46","guid":{"rendered":"https:\/\/meyn.ece.ufl.edu\/?page_id=2411"},"modified":"2026-03-25T16:05:03","modified_gmt":"2026-03-25T21:05:03","slug":"deceptive-attack-synthesis-and-its-mitigation-for-nonlinear-cyber-physical-systems","status":"publish","type":"page","link":"https:\/\/faculty.eng.ufl.edu\/meyn\/c3\/c3-9\/deceptive-attack-synthesis-and-its-mitigation-for-nonlinear-cyber-physical-systems\/","title":{"rendered":"Revealed Preference and Adaptive Inverse Reinforcement Learning"},"content":{"rendered":"<h3><b><a href=\"https:\/\/vikram.ece.cornell.edu\/\">Vikram Krishnamurthy<\/a> (Cornell)<\/b><\/h3>\n<p><span style=\"font-weight: 400\">Inverse reinforcement learning (IRL) concerns the problem of inferring an agent\u2019s objective from observations of its behavior. This talk has two related parts.<\/span><\/p>\n<p><span style=\"font-weight: 400\">In the first part, we discuss revealed preference theory and generalizations of Afriat\u2019s theorem, which provide necessary and sufficient conditions for the existence of a utility function consistent with observed datasets. The second part discusses\u00a0 adaptive IRL using passive Langevin dynamics. We show how the resulting occupancy measure is linked to the underlying utility function, and how estimation efficiency can be improved via a Nadaraya\u2013Watson regression interpretation. Finally, we discuss Malliavin derivative\u2013based estimators as an alternative to kernel smoothing. Malliavin calculus provides weak sensitivity representations that avoid bandwidth selection and naturally extend to continuous-time stochastic systems, offering a principled approach to passive IRL.<\/span><\/p>\n<p><span style=\"font-weight: 400\">This talk focuses on the underlying fundamental ideas emerging from two industrial research collaborations: predicting user engagement in online multimedia and identifying adaptive radar systems from observed emissions.<\/span><\/p>\n<p><img decoding=\"async\" class=\"alignleft\" src=\"https:\/\/vikram.ece.cornell.edu\/files\/2023\/09\/Krishnamurthy_Vikram_014_360px-300x300.jpg\" alt=\"Vikram Krishnamurthy\" \/><\/p>\n<p><b>Bio.<\/b><span style=\"font-weight: 400\">\u00a0 Vikram Krishnamurthy <\/span><span style=\"font-size: 1.25rem\">is a Professor in the School of Electrical and Computer Engineering at Cornell University, with affiliations in applied mathematics and mechanical engineering. His research spans statistical signal processing, stochastic control, and reinforcement learning, with applications to social networks, sensing systems, and decision-making under uncertainty. He is the author of the widely used monograph <\/span><em style=\"font-size: 1.25rem\">Partially Observed Markov Decision Processes: Filtering to Controlled Sensing<\/em><span style=\"font-size: 1.25rem\">. Krishnamurthy is an IEEE Fellow, recognized for contributions to statistical signal processing and controlled sensing, and has held prestigious positions including a Canada Research Chair prior to joining Cornell.\u00a0\u00a0<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Vikram Krishnamurthy (Cornell) Inverse reinforcement learning (IRL) concerns the problem of inferring an agent\u2019s objective from observations of its behavior. This talk has two related parts. In the first part, we discuss revealed preference theory and generalizations of Afriat\u2019s theorem, which provide necessary and sufficient conditions for the existence of a utility function consistent with [&hellip;]<\/p>\n","protected":false},"author":1347,"featured_media":0,"parent":2631,"menu_order":4,"comment_status":"closed","ping_status":"closed","template":"page-templates\/page-section-nav.php","meta":{"_acf_changed":false,"inline_featured_image":false,"featured_post":"","footnotes":"","_links_to":"","_links_to_target":""},"class_list":["post-2411","page","type-page","status-publish","hentry"],"acf":[],"_links":{"self":[{"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/pages\/2411","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/users\/1347"}],"replies":[{"embeddable":true,"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/comments?post=2411"}],"version-history":[{"count":2,"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/pages\/2411\/revisions"}],"predecessor-version":[{"id":2855,"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/pages\/2411\/revisions\/2855"}],"up":[{"embeddable":true,"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/pages\/2631"}],"wp:attachment":[{"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/media?parent=2411"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}