Can we Trust Chatbots for now? Accuracy, reproducibility, traceability; a Case Study on Leonardo da Vinci's Contribution to Astronomy - LAAS - Laboratoire d'Analyse et d'Architecture des Systèmes
Article Dans Une Revue Advances in Artificial Intelligence and Machine Learning Année : 2023

Can we Trust Chatbots for now? Accuracy, reproducibility, traceability; a Case Study on Leonardo da Vinci's Contribution to Astronomy

Résumé

Large Language Models (LLM) are studied. Applications to chatbots and education are considered. A case study on Leonardo's contribution to astronomy is presented. Major problems with accuracy, reproducibility and traceability of answers are reported for ChatGPT, GPT-4, BLOOM and Google Bard. Possible reasons for problems are discussed and some solutions are proposed.
Fichier principal
Vignette du fichier
AdvancesinAIRevised21.2.pdf (282.06 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04078350 , version 1 (23-04-2023)
hal-04078350 , version 2 (23-10-2023)

Licence

Copyright (Tous droits réservés)

Identifiants

Citer

Didier El Baz. Can we Trust Chatbots for now? Accuracy, reproducibility, traceability; a Case Study on Leonardo da Vinci's Contribution to Astronomy. Advances in Artificial Intelligence and Machine Learning, 2023, 3 (2), pp.1094-1109. ⟨hal-04078350v2⟩
230 Consultations
98 Téléchargements

Altmetric

Partager

More