Using Multi-modal LLMs to Create Models for Fault Diagnosis - LAAS - Laboratoire d'Analyse et d'Architecture des Systèmes
Communication Dans Un Congrès Année : 2024

Using Multi-modal LLMs to Create Models for Fault Diagnosis

Résumé

Creating models that are usable for fault diagnosis is hard. This is especially true for cyber-physical systems that are subject to architectural changes and may need to be adapted to different product variants intermittently. We therefore can no longer rely on expert-defined and static models for many systems. Instead, models need to be created more cheaply and need to adapt to different circumstances. In this article we present a novel approach to create physical models for process industry systems using multi-modal large language models (i.e ChatGPT). We present a five-step prompting approach that uses a piping and instrumentation diagram (PID) and natural language prompts as its input. We show that we are able to generate physical models of three systems of a well-known benchmark. We further show that we are able to diagnose faults for all of these systems by using the Fault Diagnosis Toolbox. We found that while multi-modal large language models (MLLMs) are a promising method for automated model creation, they have significant drawbacks.
Fichier principal
Vignette du fichier
DX24___LLM_and_Diagnosis.pdf (403.38 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04777473 , version 1 (12-11-2024)

Identifiants

Citer

Silke Merkelbach, Alexander Diedrich, Anna Sztyber-Betley, Louise Travé-Massuyès, Elodie Chanthery, et al.. Using Multi-modal LLMs to Create Models for Fault Diagnosis. The 35th International Conference on Principles of Diagnosis and Resilient Systems (DX'24), Nov 2024, vienna, Austria. ⟨10.4230/OASIcs.DX.2024.6⟩. ⟨hal-04777473⟩
10 Consultations
11 Téléchargements

Altmetric

Partager

More