Image search with 🤗 datasets

Hugging Face · 4 years ago · 29

Hugging Face's datasets library added support for image search by combining its ImageFolder loader with CLIP embeddings and FAISS indexing, allowing users to search collections of images using text queries. The demonstration used a 10,000-image dataset of embellishments from digitised British Library books, encoded with the CLIP-ViT-B-32 model to create searchable embeddings. Users can now load image datasets, embed them with sentence_transformers, index them with FAISS, and retrieve results by querying with natural language descriptions.