Running Privacy-Preserving Inferences on Hugging Face Endpoints
Hugging Face Blog
Zama released pre-compiled machine learning models on Hugging Face that perform inferences on encrypted data without exposing the original information to the server. Users can deploy these privacy-preserving models using Fully Homomorphic Encryption with a single click on Hugging Face Endpoints, currently supporting up to 8 vCPU machines. Developers can now prepare their own encrypted models following templates in Zama's repositories and contribute them to the platform, though larger-scale deployment would benefit from more powerful infrastructure.
