Microsoft Azure launches AI error auto-correction feature preview

2024-09-25

Recently, Microsoft introduced a preview of a new feature called "Correction" in Azure AI Studio. This initiative is part of Microsoft's efforts to enhance the accuracy of AI systems. Azure AI Studio is a security toolkit designed to detect vulnerabilities, identify "hallucinations" in AI outputs, and prevent malicious prompts. With this new feature, customers using Azure-powered AI systems can automatically detect and rewrite erroneous content in AI outputs.

Once enabled, the "Correction" system compares AI-generated content with the customer's original materials to identify and flag inaccuracies. The system then highlights the errors, provides explanations for them, and automatically rewrites the problematic sections—all before the user notices any mistakes. While this feature shows promise in addressing the issue of nonsensical outputs commonly produced by AI models, its reliability remains to be validated.

It is noteworthy that Google Cloud Platform's Vertex AI offers a similar feature, which anchors model outputs by comparing them with Google search results, internal data, and soon-to-be-integrated third-party datasets.

Microsoft stated that the "Correction" system aligns outputs with benchmark documents using both small and large language models. While it does not fully resolve the "accuracy" issue, it helps ensure that generative AI outputs are consistent with benchmark documents. This statement underscores the feature's role in enhancing the consistency of AI outputs while acknowledging its limitations regarding absolute accuracy.