Meta-Learning Approaches for Rapid Adaptation of Autonomous Systems to Novel Environments: A Comparative Study
Abstract
Keywords
References
Finn, Chelsea, Aravind Rajeswaran, Sham Kakade, and Sergey Levine. “Online Meta-Learning”. In Proceedings of the 36th International Conference on Machine Learning, edited by Kamalika Chaudhuri and Ruslan Salakhutdinov, 97:1920–30. Proceedings of Machine Learning Research. PMLR, 09--15 Jun 2019. Available at https://proceedings.mlr.press/v97/finn19a.html.
Finn, Chelsea, Pieter Abbeel, and Sergey Levine. “Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks”. In Proceedings of the 34th International Conference on Machine Learning, edited by Doina Precup and Yee Whye Teh, 70:1126–35. Proceedings of Machine Learning Research. PMLR, 06--11 Aug 2017. Available at https://proceedings.mlr.press/v70/finn17a.html.
Gaudet, Brian, Richard Linares, and Roberto Furfaro. “Adaptive Guidance and Integrated Navigation with Reinforcement Meta-Learning”. Acta Astronautica 169 (2020): 180–90. https://doi.org/10.1016/j.actaastro.2020.01.007.
Gaudet, Brian, Richard Linares, and Roberto Furfaro. “Terminal Adaptive Guidance via Reinforcement Meta-Learning: Applications to Autonomous Asteroid Close-Proximity Operations”. Acta Astronautica 171 (2020): 1–13. https://doi.org/10.1016/j.actaastro.2020.02.036.
Gupta, Abhishek, Russell Mendonca, Yuxuan Liu, Pieter Abbeel, and Sergey Levine. “Meta-Reinforcement Learning of Structured Exploration Strategies”. In Advances in Neural Information Processing Systems, edited by S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett, Vol. 31. Curran Associates, Inc., 2018. Available at https://proceedings.neurips.cc/paper_files/paper/2018/file/4de754248c196c85ee4fbdcee89179bd-Paper.pdf.
Kaushik, Rituraj, Timothée Anne, and Jean-Baptiste Mouret. “Fast Online Adaptation in Robotics through Meta-Learning Embeddings of Simulated Priors”. In 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 5269–76, 2020. https://doi.org/10.1109/IROS45743.2020.9341462.
Nagabandi, Anusha, Ignasi Clavera, Simin Liu, Ronald S. Fearing, Pieter Abbeel, Sergey Levine, and Chelsea Finn. “Learning to Adapt in Dynamic, Real-World Environments Through Meta-Reinforcement Learning”. arXiv [Cs.LG], 2019. arXiv. Available at http://arxiv.org/abs/1803.11347.
Nichol, Alex, Joshua Achiam, and John Schulman. “On First-Order Meta-Learning Algorithms”. arXiv [Cs.LG], 2018. arXiv. Available at http://arxiv.org/abs/1803.02999.
Rajeswaran, Aravind, Chelsea Finn, Sham M. Kakade, and Sergey Levine. “Meta-Learning with Implicit Gradients”. In Advances in Neural Information Processing Systems, edited by H. Wallach, H. Larochelle, A. Beygelzimer, F. dtextquotesingle Alché-Buc, E. Fox, and R. Garnett, Vol. 32. Curran Associates, Inc., 2019. Available at https://proceedings.neurips.cc/paper_files/paper/2019/file/072b030ba126b2f4b2374f342be9ed44-Paper.pdf.
Ravi, Sachin, and Hugo Larochelle. “Optimization as a Model for Few-Shot Learning”. In International Conference on Learning Representations, 2017. Available at https://openreview.net/forum?id=rJY0-Kcll.
Snell, Jake, Kevin Swersky, and Richard Zemel. “Prototypical Networks for Few-Shot Learning”. In Advances in Neural Information Processing Systems, edited by I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett, Vol. 30. Curran Associates, Inc., 2017. Available at https://proceedings.neurips.cc/paper_files/paper/2017/file/cb8da6767461f2812ae4290eac7cbc42-Paper.pdf.
Vinyals, Oriol, Charles Blundell, Timothy Lillicrap, Koray Kavukcuoglu, and Daan Wierstra. “Matching Networks for One Shot Learning”. In Advances in Neural Information Processing Systems, edited by D. Lee, M. Sugiyama, U. Luxburg, I. Guyon, and R. Garnett, Vol. 29. Curran Associates, Inc., 2016. Available at https://proceedings.neurips.cc/paper_files/paper/2016/file/90e1357833654983612fb05e3ec9148c-Paper.pdf.
Vuorio, Risto, Shao-Hua Sun, Hexiang Hu, and Joseph J. Lim. “Multimodal Model-Agnostic Meta-Learning via Task-Aware Modulation”. In Advances in Neural Information Processing Systems, edited by H. Wallach, H. Larochelle, A. Beygelzimer, F. dtextquotesingle Alché-Buc, E. Fox, and R. Garnett, Vol. 32. Curran Associates, Inc., 2019. Available at https://proceedings.neurips.cc/paper_files/paper/2019/file/e4da3b7fbbce2345d7772b0674a318d5-Paper.pdf.
Yu, Tianhe, Deirdre Quillen, Zhanpeng He, Ryan Julian, Karol Hausman, Chelsea Finn, and Sergey Levine. “Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learning”. In Proceedings of the Conference on Robot Learning, edited by Leslie Pack Kaelbling, Danica Kragic, and Komei Sugiura, 100:1094–1100. Proceedings of Machine Learning Research. PMLR, 30 Oct--01 Nov 2020. Available at https://proceedings.mlr.press/v100/yu20a.html.
Zhang, Chongzhen, Jianrui Wang, Gary G. Yen, Chaoqiang Zhao, Qiyu Sun, Yang Tang, Feng Qian, and Jürgen Kurths. “When Autonomous Systems Meet Accuracy and Transferability through AI: A Survey”. Patterns 1, no. 4 (10 July 2020). https://doi.org/10.1016/j.patter.2020.100050.
Refbacks
- There are currently no refbacks.
This work is licensed under a Creative Commons Attribution 3.0 License.