Cohere announced a public beta of Confidential Computing on Model Vault, its managed AI service, using NVIDIA H100 GPUs on Microsoft Azure. The system is designed to protect data while it is being processed, and customers can use remote attestation to check the environment’s hardware, firmware and software against an approved policy before sending sensitive requests. Cohere says requests are encrypted end-to-end to that environment, and customers can keep using familiar Cohere APIs. The company cautions that this protection does not replace application security, compliance, contractual controls or data-residency requirements.
Why it matters
For legal, financial and engineering teams with sensitive records or source code, the beta offers a way to check the processing environment before sending data, though it does not settle other security or compliance requirements.