AWS has a new tool that wants to stop AI hallucinations for good

Date:
Wed, 04 Dec 2024 21:42:19 +0000

Description:
AWS reveals "first and only" safeguard against AI hallucinations.

FULL STORY ======================================================================AWS unveils Automated Reasoning checks New tool will look to cut down on AI hallucinations by checking responses against customer data Customers will be presented with AI responses to see how accurate they are

With businesses increasingly using AI tools for their key processes and
tasks, hallucinations are proving to be a growing challenge.

To try and tackle this, Amazon Web Services (AWS) has announced a new tool to tackle hallucinations.

Revealed at its AWS re:Invent 2024 event, the new Automated Reasoning checks system looks to cut down on potentially damaging errors caused by hallucinations, which could see businesses face security risks or financial losses. An end to AI hallucinations?

At its simplest level, hallucinations are when an AI system or service
behaves incorrectly, or becomes unreliable, often due to issues with errors
in the data it has been trained on.

Described by the company as "the first and only generative AI safeguard that helps prevent factual errors due to model hallucinations", AWS' Automated Reasoning checks look to solve this by cross-checking the responses generated by a model against information provided by the customer. If it can't
determine if the answer matches up exactly, the response gets sent back to
the model for checking.

Available as part of Amazon Bedrock Guardrails, the company's system for keeping AI models accurate and reliable, the new checks will also attempt to see how the model came up with its answer, and if it deems it to be
erroneous, will compare to the customer's information.

It will then present its answer alongside the initial response from the
model, meaning customers can see the possible gap between the truth and the response, and tweak their model accordingly.

AWS gave the example of a healthcare provider using the tool to make sure customer enquiries about specific policies are given accurate answers.

"Over time, as generative AI transforms more companies and customer experiences, inference will become a core part of every application," said
Dr. Swami Sivasubramanian, vice president of AI and Data at AWS.

"With the launch of these new capabilities, we are innovating on behalf of customers to solve some of the top challenges, like hallucinations and cost, that the entire industry is facing when moving generative AI applications to production. You may also like Everything announced at AWS re:Invent 2024 you might have missed Amazon CEO outlines its AI vision, and challenges Weve listed the best AI writers around today



======================================================================
Link to news story: https://www.techradar.com/pro/aws-has-a-new-tool-that-wants-to-stop-ai-halluci nations-for-good


--- Mystic BBS v1.12 A47 (Linux/64)
* Origin: tqwNet Technology News (1337:1/100)