Guardrails for Generative AI Models are Being Developed by WitnessAI

by

in

– Generative AI can be biased and produce toxic text
– WitnessAI offers risk-mitigating policies and safeguards to make generative AI safe for enterprise use
– WitnessAI raised $27.5 million in funding to grow its team and compete in the market for model compliance and governance solutions.

Generative AI has the ability to create content, but it can also be biased or produce toxic text. Rick Caccia, the CEO of WitnessAI, believes that securing AI models is essential to address the potential risks associated with their use. WitnessAI’s platform works to intercept activity between employees and generative AI models used by their employer, applying risk-mitigating policies and safeguards to protect sensitive data.

Despite the growing demand for generative AI-related roles in the enterprise, many companies are not prepared to manage threats related to the use of this technology, including privacy and intellectual property concerns. WitnessAI offers modules to address different forms of generative AI risk, such as preventing staff from misusing AI tools or redacting sensitive information from prompts sent to models.

While WitnessAI prioritizes data protection and privacy, concerns about employee surveillance and morale remain. Nonetheless, the platform has seen strong interest from early corporate users and has received funding from Ballistic Ventures and Google’s corporate venture arm. The company plans to use this funding to expand its team and compete with other players in the market for model compliance and governance solutions.

In the face of competition from tech giants and startups, WitnessAI is focused on developing features to address the evolving market for secure AI enablement and use. Despite concerns about privacy, the company remains confident in its ability to meet sales targets and grow in this new area of technology.

Source link