01486nas a2200109 4500000000100000008004100001100002000042700001800062700002100080245007800101520119700179 2026 d1 aŁukasz Sobczak1 aNur Kelesoglu1 aJoanna Domańska00aReliability-Aware LLM Reasoning: Handling Uncertainty in Robot Perception3 a
Robots operating in human environments must often make decisions based on perceptual information that
is uncertain, incomplete, or ambiguous. This paper proposes a reliability-aware reasoning framework that enables large
language models (LLMs) to account for perceptual uncertainty when selecting actions in human-robot interaction scenarios.
The environment is represented as a structured scene composed of detected objects enriched with confidence estimates, attribute reliability, and spatial uncertainty information. Using this representation, the LLM evaluates candidate objects through a reliability scoring mechanism that integrates multiple sources of perceptual evidence and supports uncertainty-aware decision making.The proposed approach is evaluated using perception episodes with controlled levels of uncertainty and compared with a baseline LLM-based matching strategy that ignores perceptual
reliability. Experimental results show that incorporating uncertainty-aware reasoning substantially improves decision
robustness under medium and high uncertainty conditions while reducing safety-critical behaviors caused by overconfident
autonomous decisions.