CNAI4S
智算平台热点追踪算子框架领域模型科学任务智算套件数据资源智算评测协作社区运行情况

友情链接

科技部工信部北京航空航天大学浙江大学
中山大学北京大学华中科技大学之江实验室
百度飞桨华为昇思中科可控
版权所有:科学智算共性平台 京ICP备18020905号-2
京公网安备11010802046602号
联系邮箱: tianyuc@buaa.edu.cn
Temporal Gradient Inversion for Private Trajectory Reconstruction in Embodied Reinforcement Learning
返回热点追踪
新闻Astronomy

Temporal Gradient Inversion for Private Trajectory Reconstruction in Embodied Reinforcement Learning

a
arXiv AI4S Papers
2026年9月25日技术突破
摘要

Distributed learning in embodied reinforcement-learning agents offers a degree of privacy by retaining raw sensor data on-device and transmitting only policy gradients to the serve

Distributed learning in embodied reinforcement-learning agents offers a degree of privacy by retaining raw sensor data on-device and transmitting only policy gradients to the server. Yet temporal structure can amplify this leakage beyond single-frame attacks. We introduce Temporal Reconstruction Attack on Consecutive Encodings (TRACE), an amortized temporal gradient-inversion attack that autoregressively reconstructs the sequence of private observation-action trajectories from per-step policy-learning gradients. The attack exploits two structural signals ignored by prior single-frame methods: (i) cross-time correlation between successive embodied gradients, which we formalize via a conditional mutual-information bound, and (ii) closed-form action recovery from policy-head gradient structure, which we prove exact when standard entropy regularization is sufficiently small. On held-out embodied scenes, TRACE reaches $18.8$ dB PSNR with near-perfect action recovery at $3$-$4.5$ ms per reconstructed frame, dominating the learning-based baseline across all reconstruction metrics and exceeding optimization attacks while running orders of magnitude faster. Further evaluation demonstrates TRACE's broader applicability across recurrent, residual, and compact transformer victim architectures, multi-modal inputs, and larger discrete action spaces. Defense experiments suggest that protecting temporal gradient streams may require sequence-aware privacy mechanisms.

查看原文 →

相关推荐

Molecular Beam Epitaxy of AgTaO3
新闻Astronomy

Molecular Beam Epitaxy of AgTaO3

Tobias Schwaigert, Joshua Maile, Olivia Peek

PoEM: Predicting RL Outcomes from Existing Policies
新闻Astronomy

PoEM: Predicting RL Outcomes from Existing Policies

Kimia Hamidieh, Giannis Daras, Antonio Torralba

Underwater C3-JEPA: An Object-Centric Cross-View World Model for ROV Salvage
新闻Astronomy

Underwater C3-JEPA: An Object-Centric Cross-View World Model for ROV Salvage

Yuncong Yang, Jinlong Li, Yulong Xue

The Alignment Illusion in Multimodal Large Language Models
新闻Astronomy

The Alignment Illusion in Multimodal Large Language Models

Hong-Han Wang, Yuntao Wang, Hu Ding