Advancing Object-Goal Navigation
through LLM-Enhanced Object Affinities Transfer

[1]Institute of Automation, Chinese Academy of Sciences, [2]Georgia Institute of Technology,
[3]ETH Zurich, [4]Northwestern University
IROS 2025

*Indicates Equal Contribution

Video presentation for LOAT.

Abstract

Object-goal navigation requires mobile robots to efficiently locate targets with visual and spatial information, yet existing methods struggle with generalization in unseen environments. Heuristic approaches with naive metrics fail in complex layouts, while graph-based and learning-based methods suffer from environmental biases and limited generalization. Although Large Language Models (LLMs) as planners or agents offer a rich knowledge base, they are cost-inefficient and lack targeted historical experience. To address these challenges, we propose the LLM-enhanced Object Affinities Transfer (LOAT) framework, integrating LLM-derived semantics with learning-based approaches to leverage experiential object affinities for better generalization in unseen settings. LOAT employs a dual-module strategy: one module accesses LLMs' vast knowledge, and the other applies learned object semantic relationships, dynamically fusing these sources based on context. Evaluations in AI2-THOR and Habitat simulators show significant improvements in navigation success and efficiency, and real-world deployment demonstrates the zero-shot ability of LOAT to enhance object-goal navigation systems.

Poster

BibTeX

@INPROCEEDINGS{11247308,
  author={Lin, Mengying and Liu, Shugao and Zhang, Dingxi and Chen, Yaran and Wang, Zhaoran and Li, Haoran and Zhao, Dongbin},
  booktitle={2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)}, 
  title={Advancing Object-Goal Navigation through LLM-enhanced Object Affinities Transfer}, 
  year={2025},
  volume={},
  number={},
  pages={18458-18465},
  keywords={Training;Measurement;Learning systems;Vocabulary;Visualization;Navigation;Semantics;Habitats;Predictive models;Mobile robots},
  doi={10.1109/IROS60139.2025.11247308}}