Hardware-backed AI controls target data custody and agent authority separately
Cohere’s confidential-inference beta and NVIDIA’s new deployment designs move protection into hardware, while Sentry’s agent-control framework remains planned for early 2027.
Cohere’s October 22 Model Vault beta uses NVIDIA H100 confidential computing on Microsoft Azure to protect data during inference.
Its client verifies signed evidence about the hardware and software environment before releasing a sensitive request, and refuses transmission if the environment fails the configured policy. Requests stay encrypted through intermediaries and are decrypted inside the attested boundary. [1][4]
NVIDIA’s October 21 Confidential Bare Metal announcement addresses custody on dedicated third-party infrastructure through platform-integrity checks and hardware access restrictions. Its technical documentation keeps the infrastructure owner outside the runtime trust boundary, but trusts the tenant’s software and administrators: it does not protect downstream users’ data from that tenant. Protection depends on the deployed configuration. [2][5]
A separate NVIDIA design, Sentry, puts policy enforcement and runtime observation in a BlueField-4 hardware domain outside the agent’s host software. The October 21 technical account says availability is planned for early 2027; existing DOCA components support earlier experimentation. A reference architecture is not evidence that a customer deployment has achieved its promised protection. [3][6][7]
These controls answer different questions. Confidential inference reduces who can see a workload’s plaintext. Agent enforcement limits which actions it may take. Neither replaces application permissions, a suitable security policy or the obligations attached to the data. Ask a supplier to demonstrate the exact boundary, attestation behavior and failure response that will be deployed. [1][2][3][5]
Sources & details 7 sources
Discuss in your voice app
Take the reporting, visual explanations and original sources into a conversation. Copy the brief, paste it into your preferred assistant, then start its voice mode.
Paste the brief into your voice app to discuss this reporting.Reporting sources
- Cohere · Confidential Model Vault beta
October22 public beta; H100/Azure, client verification and stated residual controls inspected.
- NVIDIA · Confidential Bare Metal
October21 vendor architecture and provider-support announcement.
- NVIDIA · Sentry technical architecture
October21 technical detail; planned early2027 availability. Source candidate query URL resolves to this canonical article.
- Inside Model Vault’s confidential inference
Detailed vendor architecture and explicit trust limits.
- NVIDIA Confidential Bare Metal technical documentation
Dedicated-tenant trust boundary and downstream-user limitations.
- NVIDIA OpenShell reference architecture
Vendor reference, not independently verified deployment.
- NVIDIA Sentry product description
Hardware isolation architecture; announced timing remains in dated technical post.
Images & figures
Confidential inference controls access to plaintext. An independent enforcement layer controls the agent’s reach. They solve different parts of the trust problem.
Euangelion · Source · Usage terms