Running Privacy-Preserving Inferences on Hugging Face Endpoints

Hugging Face Blog · 2 years ago

Zama released pre-compiled machine learning models on Hugging Face that perform inferences on encrypted data without exposing the original information to the server. Users can deploy these privacy-preserving models using Fully Homomorphic Encryption with a single click on Hugging Face Endpoints, currently supporting up to 8 vCPU machines. Developers can now prepare their own encrypted models following templates in Zama's repositories and contribute them to the platform, though larger-scale deployment would benefit from more powerful infrastructure.