Publication details

Semantically Labelled Automata for Multi-Task Reinforcement Learning with LTL Instructions

Authors

ABATE Alessandro DE GIACOMO Giuseppe JACKERMEIER Mathias KŘETÍNSKÝ Jan PROKOP Maximilian WEINHUBER Christoph

Year of publication 2026
Type Paper in proceedings
Citation
web https://www.ijcai.org/proceedings/2026/1
Doi https://doi.org/10.24963
Description We study multi-task reinforcement learning (RL), a setting in which an agent learns a single, universal policy capable of generalising to arbitrary, possibly unseen tasks. We consider tasks specified as linear temporal logic (LTL) formulae, which are commonly used in formal methods to specify properties of systems, and have recently been successfully adopted in RL. In this setting, we present a novel task embedding technique leveraging a new generation of semantic LTL-to-automata translations, originally developed for temporal synthesis. The resulting semantically labelled automata contain rich, structured information in each state that allow us to (i) compute the automaton efficiently on-the-fly, (ii) extract expressive task embeddings used to condition the policy, and (iii) naturally support full LTL. Experimental results in a variety of domains demonstrate that our approach achieves state-of-the-art performance and is able to scale to complex specifications where existing methods fail.
Related projects:

You are running an old browser version. We recommend updating your browser to its latest version.

More info