Please stop guessing dates and ages
in progress
J
Jamie McConnell
All LLMs hallucinate, but Heidi seems to have a particular propensity for hallucinating dates for when a procedure supposedly happened, and making up patient age. It particularly likes to pretend that MRI scans were done on today's date, which is
never
true.I know that this kind of error is hard to contain, but such an obvious and unnecessary hallucination undermines confidence in the system. Can I suggest introducing a validator that ensures that dates and ages are only included if specifically mentioned in the transcript?
Mo from Heidi
in progress
S
Susan Perel
Agree with others that AI is assuming the current year is 2023 not 2024. If I state e.g. "test was done on 2nd December this year", it will come out as test performed 2/12/2023.
Canny AI
Merged in a post:
Identifying wrong year in transcripts
Samuel Jeffery
When talking about events (Such as operation or scan dates) in consultations, the generated notes is recording these as 2023 rather than 2024, even when mentioned that it was this year and when scan reports with correct dates have been added to the context.
Canny AI
Merged in a post:
Heidi making up things in referrals
Mahi Gill
Often create a referral through ask heidi and it will make up certain things not from the prompts or history. For example, 3 or 4 times Heidi has "patient reported pain as x/10" which was not in the history or mentioned in ask heidi.
S
Sasha Kovacevic
Hey Mahi, could you please share an example of the session ID number or URL and/or document name where you've seen Heidi mentioning a pain rating out of 10? With your permission we'd like to review the session(s) in question so we can figure out what the reason for this appearing could be.
Mahi Gill
Sasha Kovacevic I'm sorry I've only just seen this response and have deleted the old sessions. If this happens again I will send the session across
Mo from Heidi
Merged in a post:
Identifying wrong year in transcripts
Samuel Jeffery
When talking about events (Such as operation or scan dates) in consultations, the generated notes is recording these as 2023 rather than 2024, even when mentioned that it was this year and when scan reports with correct dates have been added to the context.
F
Fiona Chow
I had the same problem, but I fixed it by putting in the custom template the command (note that the current year is 2024). After this, the notes have been consistently correct. In 2025, I will change the command so that it reflects the current year.
Canny AI
Merged in a post:
Year of investigations
Michael Jansz
If an investigation (labs, etc.) are done on a specific date (i.e. September 1) but a year is not mentioned, the AI seems to default to the year of 2022 (instead of current year)