Mungojerrie: Linear-Time Objectives in Model-Free Reinforcement Learning

Ernst Moritz Hahn, Mateo Perez, Sven Schewe, Fabio Somenzi*, Ashutosh Trivedi, Dominik Wojtczak

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

3 Citations (Scopus)
2 Downloads (Pure)

Abstract

Mungojerrie is an extensible tool that provides a framework to translate linear-time objectives into reward for reinforcement learning (RL). The tool provides convergent RL algorithms for stochastic games, reference implementations of existing reward translations for ω -regular objectives, and an internal probabilistic model checker for ω -regular objectives. This functionality is modular and operates on shared data structures, which enables fast development of new translation techniques. Mungojerrie supports finite models specified in PRISM and ω -automata specified in the HOA format, with an integrated command line interface to external linear temporal logic translators. Mungojerrie is distributed with a set of benchmarks for ω -regular objectives in RL.

Original languageEnglish
Title of host publicationTools and Algorithms for the Construction and Analysis of Systems - 29th International Conference, TACAS 2023, Held as Part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2022, Proceedings
EditorsSriram Sankaranarayanan, Natasha Sharygina
PublisherSpringer
Pages527-545
Number of pages19
ISBN (Print)9783031308222
DOIs
Publication statusPublished - 22 Apr 2023
Event29th International Conference on Tools and Algorithms for the Construction and Analysis of Systems, TACAS 2023 - Paris, France
Duration: 22 Apr 202327 Apr 2023
Conference number: 29

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13993 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference29th International Conference on Tools and Algorithms for the Construction and Analysis of Systems, TACAS 2023
Abbreviated titleTACAS 2023
Country/TerritoryFrance
CityParis
Period22/04/2327/04/23

Fingerprint

Dive into the research topics of 'Mungojerrie: Linear-Time Objectives in Model-Free Reinforcement Learning'. Together they form a unique fingerprint.

Cite this