Towards LLM-enhanced Conflict Detection and Resolution in Model Versioning
In the past two decades, a range of model versioning workflows have been proposed. Standard workflows are based on three-way model merging, which allows reasoning on potentially conflicting changes in concurrently developed model versions. However, the considered conflicts that can be detected are mostly targeting the syntactic level of models, such as update/update or delete/usage conflicts. In contrast, unintended semantic inconsistencies often remain unnoticed as detection mechanisms lack the semantic awareness of the modeling language or modeled domain. The resolution of such conflicts remains a manual task.
In this paper, we explore how Large Language Models (LLMs) can augment model versioning workflows by supporting conflict detection and resolution. In particular, we present an LLM-enhanced solution for detecting conflicts in the three-way model merging setting. Drawing on a collection of conflict types from prior literature, we demonstrate how an LLM assistant can 1) pinpoint conflicting changes and 2) provide resolution options with clear rationales and explanations of their implications. Our results indicate that the LLMs’ access to a broad range of domains and modeling languages can help find and resolve complex versioning conflicts. Our implementation combines the industrial tool LemonTree for analyzing models and model changes, with a GPT-4o (LLM) assistant primed with relevant context to detect and resolve conflicts. We conclude by discussing directions for future research to improve model versioning workflows using LLMs.
Wed 8 OctDisplayed time zone: Eastern Time (US & Canada) change
14:00 - 15:30 | Session 3: Large Language Models and ModelingResearch Papers / New Ideas and Emerging Results (NIER) at DCIH 102 Chair(s): Bentley Oakes Polytechnique Montréal Hybrid | ||
14:00 18mTalk | MCeT: Behavioral Model Correctness Evaluation using Large Language ModelsFT Research Papers Khaled Ahmed Huawei Research Canada, University of British Columbia (UBC), Jialing Song Huawei Technologies Canada, Boqi Chen McGill University, Ou Wei Huawei Technologies Canada, Bingzhou Zheng Huawei Technologies Canada Pre-print | ||
14:18 18mTalk | Model-Driven Quantum Code Generation Using Large Language Models and Retrieval-Augmented Generation New Ideas and Emerging Results (NIER) Nazanin Siavash University of Colorado Colorado Springs (UCCS), Armin Moin University of Colorado Colorado Springs | ||
14:36 18mTalk | Towards LLM-enhanced Conflict Detection and Resolution in Model Versioning New Ideas and Emerging Results (NIER) Martin Eisenberg Johannes Kepler University, Linz, Stefan Klikovits Johannes Kepler University, Linz, Manuel Wimmer JKU Linz, Konrad Wieland LieberLieber Software GmbH | ||
14:54 18mTalk | SHERPA: A Model-Driven Framework for Large Language Model Execution Research Papers Boqi Chen McGill University, Kua Chen McGill University, José Antonio Hernández López Department of Computer Science and Systems, University of Murcia, Gunter Mussbacher McGill University, Daniel Varro Linköping University / McGill University, Amir Feizpour Aggregate Intellect Pre-print | ||
15:12 18mTalk | Accurate and Consistent Graph Model Generation from Text with Large Language Models Research Papers Boqi Chen McGill University, Ou Wei Huawei Technologies Canada, Bingzhou Zheng Huawei Technologies Canada, Gunter Mussbacher McGill University Pre-print | ||