Today I needed to search jobs by name. I couldn’t figure out how to do it. So I asked Duo, the very first thing I have asked it.
It made up a feature that did not exist, which it took me a while to realise.
Hi @aaronclawrence, this is very unfortunate. Hallucination can happen with LLMs. Could you share your prompt, the client you were using and if you used GitLab web application which kind of page you were on? This will help us improve the chat.
2 Likes
Sorry, I didn’t see this followup question.
Don’t you have records of the Gitlab duo chat?
I don’t keep records myself.
Hi @aaronclawrence, no we do not have access to the questions that you ask in Duo Chat, nor the answers to those questions. This is your data and we don’t touch it.
Next time you run into an issue, it would be great if you could capture your observation in an issue in Issues · GitLab.org / GitLab · GitLab. Include details:
- The exact question
- Was there history in your conversation or was it a newly started conversation
- Where did you ask the question (on which gitlab page or in an IDE)
- What context did you add? (e.g. by selecting code in the IDE)
- The answer you got
- How satisfied/unsatisfied you were with the answer.
Then we can follow up. Your feedback is very helpful.
Regards, Torsten
1 Like