I am a second-year PhD student at Deep Reinforcement Learning (DRL) Lab, Tianjin University (TJU), advised by Prof. Jianye Hao. I am also co-advised by Prof. Yan Zheng. I interned at Netease Fuxi AI Lab (Fuxi) during 2023, where I worked with Dr. Yujing Hu. Now I intern at Tencent AI Lab, advised by Prof. Zhongwen Xu. I received my Bachelor's degree from the Dalian University of Technology (DUT), advised by Prof. Guozhen Tan.
Research interest
I am broadly interested in research on the building embodied agents for decision making. To achieve this, my current research interest contains Model-based reinforcement learning, Diffusion Model, RLHF and LLM agents. I hope to ride the wave of AI changing the world.
News
-
Sept 26, 2024Three papers accepted by NeurIPS 2024:"CleanDiffuser: An Easy-to-use Modularized Library for Diffusion Models in Decision Making", "DiffuserLite: Towards Real-time Diffusion Planning", "PERIA: Perceive, Reason, Imagine, Act via Holistic Language and Vision Planning for Manipulation"
-
Aug 04, 2024I was invited to give a presentation in the THU MOS with the topic: "Diffusion Models for Decision Making" video
-
May 2, 2024One papers accepted by ICML 2024: "KISA: A Unified Keyframe Identifier and Skill Annotator for Long-Horizon Robotics Demonstrations"
-
Jan 15, 2024Two papers accepted by ICLR 2024: "Aligning Diverse Human Preferences via Behavior-Customisable Diffusion Model", "Uni-RLHF: Universal Platform and Benchmark Suite for Reinforcement Learning with Diverse Human Feedback"
-
Dec 03, 2023I was invited by DAI2023 to give a presentation: "Unsupervised Reinforcement Learning with World Model"
-
May 10, 2023One papers accepted by ICML 2023: "MetaDiffuser: Diffusion Model as Conditional Planner for Offline Meta-RL"
-
Jan 20, 2023One papers accepted by ICLR 2023: "EUCLID: Towards Efficient Unsupervised Reinforcement Learning with Multi-choice Dynamics Model"
Publications and preprints
Papers sorted by recency. Authors with equal contribution are marked by *. Representative papers are highlighted.
MODULI: Unlocking Preference Generalization via Diffusion Models for Offline Multi-Objective Reinforcement Learning
Yifu Yuan*, Zhenrui Zheng*, Zibin Dong, Jianye HAO
Preprint
arXiv
Yifu Yuan*, Zhenrui Zheng*, Zibin Dong, Jianye HAO
Preprint
arXiv
CleanDiffuser: An Easy-to-use Modularized Library for Diffusion Models in Decision Making
Zibin Dong*, Yifu Yuan*, Jianye HAO, Fei Ni, Yi Ma, Pengyi Li, Yan Zheng
Conference on Neural Information Processing Systems (NeurIPS Datasets and Benchmarks Track), 2024
arXiv / code / docs
Zibin Dong*, Yifu Yuan*, Jianye HAO, Fei Ni, Yi Ma, Pengyi Li, Yan Zheng
Conference on Neural Information Processing Systems (NeurIPS Datasets and Benchmarks Track), 2024
arXiv / code / docs
DiffuserLite: Towards
Real-time Diffusion Planning
Zibin Dong, Jianye Hao, Yifu Yuan, Fei Ni, Yitian Wang, Pengyi Li, Yan Zheng
Conference on Neural Information Processing Systems (NeurIPS), 2024
project page / arXiv
Zibin Dong, Jianye Hao, Yifu Yuan, Fei Ni, Yitian Wang, Pengyi Li, Yan Zheng
Conference on Neural Information Processing Systems (NeurIPS), 2024
project page / arXiv
PERIA: Perceive, Reason, Imagine, Act via Holistic Language and Vision Planning for Manipulation
Fei Ni, Jianye HAO, Shiguang Wu, Longxin Kou, Yifu Yuan, Zibin Dong, Jinyi Liu, MingZhi Li, YAN ZHENG, Yuzheng Zhuang
Conference on Neural Information Processing Systems (NeurIPS), 2024
coming soon
Fei Ni, Jianye HAO, Shiguang Wu, Longxin Kou, Yifu Yuan, Zibin Dong, Jinyi Liu, MingZhi Li, YAN ZHENG, Yuzheng Zhuang
Conference on Neural Information Processing Systems (NeurIPS), 2024
coming soon
KISA: A Unified Keyframe Identifier and Skill Annotator for Long-Horizon Robotics Demonstrations
Longxin Kou, Fei Ni, YAN ZHENG, Jinyi Liu, Yifu Yuan, Zibin Dong, Jianye HAO
International Conference on Machine Learning (ICML), 2024
pdf
Longxin Kou, Fei Ni, YAN ZHENG, Jinyi Liu, Yifu Yuan, Zibin Dong, Jianye HAO
International Conference on Machine Learning (ICML), 2024
A Method on Searching Better Activation Functions
Haoyuan Sun, Zihao Wu, Bo Xia, Pu Chang, Zibin Dong, Yifu Yuan, Yongzhe Chang, Xueqian Wang
Preprint
arXiv
Haoyuan Sun, Zihao Wu, Bo Xia, Pu Chang, Zibin Dong, Yifu Yuan, Yongzhe Chang, Xueqian Wang
Preprint
arXiv
MENTOR: Guiding Hierarchical Reinforcement Learning with Human Feedback and Dynamic Distance Constraint
Xinglin Zhou, Yifu Yuan, Shaofu Yang, Jianye Hao
Submitted to IETCI
arXiv
Xinglin Zhou, Yifu Yuan, Shaofu Yang, Jianye Hao
Submitted to IETCI
arXiv
SheetAgent: A Generalist Agent for Spreadsheet Reasoning and
Manipulation via Large Language Models
Yibin Chen*, Yifu Yuan*, Zeyu Zhang, Yan Zheng, Jinyi Liu, Fei Ni, Jianye HAO
IJCAI2024 Automates Workshop
project page / arXiv
Yibin Chen*, Yifu Yuan*, Zeyu Zhang, Yan Zheng, Jinyi Liu, Fei Ni, Jianye HAO
IJCAI2024 Automates Workshop
project page / arXiv
CriticGPT: Multimodal LLM as a Critic for Robot
Manipulation
Jinyi Liu*, Yifu Yuan*, Jianye HAO, Fei Ni, Lingzhi Fu, Yibin Chen, Yan Zheng
AAAI2024 RL+LLMs Workshop
project page / arXiv
Jinyi Liu*, Yifu Yuan*, Jianye HAO, Fei Ni, Lingzhi Fu, Yibin Chen, Yan Zheng
AAAI2024 RL+LLMs Workshop
project page / arXiv
Uni-RLHF: Universal Platform
and Benchmark Suite for Reinforcement Learning with Diverse Human Feedback
Yifu Yuan, Jianye Hao, Yi Ma, Zibin Dong, Hebin Liang, Jinyi Liu, Zhixin Feng, Kai Zhao, Yan Zheng
International Conference on Learning Representations (ICLR), 2024
project page / arXiv / benchmark / platform
Yifu Yuan, Jianye Hao, Yi Ma, Zibin Dong, Hebin Liang, Jinyi Liu, Zhixin Feng, Kai Zhao, Yan Zheng
International Conference on Learning Representations (ICLR), 2024
project page / arXiv / benchmark / platform
AlignDiff: Aligning Diverse
Human Preferences via Behavior-Customisable Diffusion Model
Zibin Dong*, Yifu Yuan*, Jianye Hao, Fei Ni, Yao Mu, Yan Zheng, Yujing Hu, Tangjie Lv, Changjie Fan, Zhipeng Hu
International Conference on Learning Representations (ICLR), 2024
NeurIPS Diffusion Workshop, 2023
project page / arXiv / code / dataset
Zibin Dong*, Yifu Yuan*, Jianye Hao, Fei Ni, Yao Mu, Yan Zheng, Yujing Hu, Tangjie Lv, Changjie Fan, Zhipeng Hu
International Conference on Learning Representations (ICLR), 2024
NeurIPS Diffusion Workshop, 2023
project page / arXiv / code / dataset
ED2: Environment Dynamics
Decomposition World Models for Continuous Control
Jianye Hao, Yifu Yuan* (student first author), Cong Wang, Zhen Wang
Submitted to TNNLS
arXiv / code
Jianye Hao, Yifu Yuan* (student first author), Cong Wang, Zhen Wang
Submitted to TNNLS
arXiv / code
MetaDiffuser: Diffusion Model
as Conditional Planner for Offline Meta-RL
Fei Ni, Jianye Hao, Yao Mu, Yifu Yuan, Yan Zheng, Bin Wang, Zhixuan Liang
International Conference on Machine Learning (ICML), 2023
project page / arXiv
Fei Ni, Jianye Hao, Yao Mu, Yifu Yuan, Yan Zheng, Bin Wang, Zhixuan Liang
International Conference on Machine Learning (ICML), 2023
project page / arXiv
EUCLID: Towards Efficient
Unsupervised Reinforcement Learning with Multi-choice Dynamics Model
Yifu Yuan, Jianye Hao, Fei Ni, Yao Mu, Yan Zheng, Yujing Hu, Jinyi Liu, Yingfeng Chen, Changjie Fan
International Conference on Learning Representations (ICLR), 2023
NeurIPS DeepRL workshop, 2022
project page / pretrained model / arXiv / code
Yifu Yuan, Jianye Hao, Fei Ni, Yao Mu, Yan Zheng, Yujing Hu, Jinyi Liu, Yingfeng Chen, Changjie Fan
International Conference on Learning Representations (ICLR), 2023
NeurIPS DeepRL workshop, 2022
project page / pretrained model / arXiv / code
Misc. open-source projects
Education & Internship Experiences
-
2024.07 -AI Researcher (Intern, Hornbill Programme), Tencent AI Lab, Tencent, ShenZhen(advised by Zhongwen Xu)
-
2023.09 -Phd student, College of Intelligence and Computing, Tianjin University(advised by Jianye Hao)
-
2022.11 - 2024.05AI Researcher (Intern), Fuxi AI Lab, NetEase, HangZhou(advised by Yujing Hu)
-
2021.09 - 2023.06Master, College of Intelligence and Computing, Tianjin University(advised by Jianye Hao, transfer to a PhD student)
-
2017.09 - 2021.06Bachelor, Electronic Information and Electrical Engineering Department, Dalian University of Technology(advised by Guozhen Tan)
Invited Talks
-
2023.12Unsupervised Reinforcement Learning with World ModelThe 5th International Conference on Distributed Artificial Intelligence (DAI 2023), Singapore
-
2023.06EUCLID: Towards Efficient Unsupervised Reinforcement Learning with Multi-choice Dynamics ModelRLChina Seminarvideo
-
2023.03EUCLID: Towards Efficient Unsupervised Reinforcement Learning with Multi-choice Dynamics ModelAI Time Seminar
Academic Service
Reviewers: ICML2024, UAI2024, ECAI2024, NeurIPS 2024, ICLR2025Awards
-
2018.11National Scholarship (国家奖学金)
-
2018.10 & 2019.10Pacemaker to Merit Student (< 2%)
-
2021.06Outstanding Graduates of Dalian City (Top 4%)
-
2022.09The First Prize Academic Scholarship (Top 10%)
-
2024.05Tencent Hornbill Elite Talent Programme (腾讯犀牛鸟精英人才计划)