Press Release, March 13, 2024
Bochum, Germany — March 13, 2024
Since the release of ChatGPT, generative artificial intelligence (AI) has been transformative across industries and has found its way into a plentitude of productivity-boosting products. However, enterprises, public sector entities, and consumers alike are reluctant to use AI services with sensitive data due to concerns about data leaks and the potential for AI models to be further trained on their input data.
To address this fundamental issue, Edgeless Systems today announced the launch of Continuum, a pioneering security solution that enables cloud-based "Confidential AI" services for the first time. At its core, Continuum ensures that user requests (or "prompts") and the corresponding replies remain encrypted throughout within an AI service, making plaintext data inaccessible to both the AI service provider and the underlying cloud infrastructure. Furthermore, it protects the often highly valuable weights of AI models in the same manner. To achieve this, Continuum leverages the confidential computing capabilities of Nvidia H100 GPUs in concert with cutting-edge cryptography and innovative sandboxing technology, allowing AI service providers to freely update models and code without compromising security.
AI service providers benefit from Continuum's straightforward integration into their existing software stacks and from unparalleled protection for their AI models and intellectual property. Users of AI services gain from Continuum's assurance of compliance and privacy, addressing concerns over data security and unauthorized use in future AI training.
Continuum works with state-of-the-art large language models (LLMs) like Mistral 7B and supports popular AI serving frameworks like Nvidia Triton Inference Server and vLLM.
Felix Schuster, CEO of Edgeless Systems, remarked, "Continuum will significantly influence the generative AI market, allowing a wider range of enterprises, particularly those in regulated sectors, to confidently utilize offerings like chatbots. This product embodies our mission to enable the use of cloud services without compromising on data security or compliance."
About Edgeless Systems
Edgeless Systems is a cybersecurity company that makes the public cloud the safest place for sensitive data. With world-leading open-source solutions for confidential computing, Edgeless Systems takes security to an unprecedented level and works with well-known companies such as Capgemini, Thales, Intel, and the Swiss stock exchange SIX. Edgeless Systems hosts the annual Open Confidential Computing Conference (OC3), where top executives from Intel, Microsoft, AMD, NVIDIA, and others discuss the state of confidential computing.
Media contact
Katharina Heller
katharina@helleryeah.com
