2026-04-12T20:02:33Z https://ipsj.ixsq.nii.ac.jp/oai

oai:ipsj.ixsq.nii.ac.jp:00209715 2025-01-19T18:25:39Z 1164:2735:10526:10527

Generating Intrinsic Rewards by Random Recurrent Network Distillation Generating Intrinsic Rewards by Random Recurrent Network Distillation Zefeng, Xu Koichi, Moriyama Tohgoroh, Matsui Atsuko, Mutoh Nobuhiro, Inuzuka Zefeng, Xu Koichi, Moriyama Tohgoroh, Matsui Atsuko, Mutoh Nobuhiro, Inuzuka Exploration in sparse reward environments pose significant challenges for many reinforcement learning algorithms. Rather than solely relying on extrinsic rewards provided by environments, many state-of-the-art methods generate intrinsic rewards to encourage the agent explore the environments. However, we found that existing models fall short in some environments, where the agent must visit a same state more than once. Thus, we improve an existing model to propose a novel type of intrinsic exploration bonus which will reward the agent when a new sequence is discovered. The intrinsic reward is the error of a recurrent neural network predicting features of the sequences given by a fixed randomly initialized recurrent neural network. Our approach performs well in some Atari games where conditions must be fulfilled to develop stories. Exploration in sparse reward environments pose significant challenges for many reinforcement learning algorithms. Rather than solely relying on extrinsic rewards provided by environments, many state-of-the-art methods generate intrinsic rewards to encourage the agent explore the environments. However, we found that existing models fall short in some environments, where the agent must visit a same state more than once. Thus, we improve an existing model to propose a novel type of intrinsic exploration bonus which will reward the agent when a new sequence is discovered. The intrinsic reward is the error of a recurrent neural network predicting features of the sequences given by a fixed randomly initialized recurrent neural network. Our approach performs well in some Atari games where conditions must be fulfilled to develop stories. 情報処理学会 2021-02-22 eng technical report https://ipsj.ixsq.nii.ac.jp/records/209715 2188-8833 AN10505667 研究報告数理モデル化と問題解決（MPS） 2021-MPS-132 15 1 6 https://ipsj.ixsq.nii.ac.jp/record/209715/files/IPSJ-MPS21132015.pdf application/pdf 1.6 MB 2023-02-22