Every AI story that matters — and the intelligence behind it.

TLDRocket reads all relevant sources, removes duplicate coverage, and publishes a short neutral summary of every story, linking back to the original. Free, no spam, unsubscribe anytime.

Add to Slack

Every story also updates live profiles event timelines weekly rankings the AI Market Index

Wednesday, 16 March 2022

Image search with 🤗 datasets

Hugging Face 4 years ago 33

Hugging Face's datasets library added support for image search by combining its ImageFolder loader with CLIP embeddings and FAISS indexing, allowing users to search collections of images using text queries. The demonstration used a 10,000-image dataset of embellishments from digitised British Library books, encoded with the CLIP-ViT-B-32 model to create searchable embeddings. Users can now load image datasets, embed them with sentence_transformers, index them with FAISS, and retrieve results by querying with natural language descriptions.

Read the full story

Hugging Face

Accelerate BERT inference with Hugging Face Transformers and AWS Inferentia

Hugging Face 4 years ago 36

Hugging Face Transformers and AWS released a tutorial for deploying BERT models on AWS Inferentia chips, custom hardware designed to accelerate inference workloads. AWS Inferentia delivers up to 80% lower cost per inference and 2.3X higher throughput than comparable GPU instances, with the tutorial achieving 5-6ms latency for sequence length 128. Companies moving BERT to production can reduce inference costs and increase throughput by using Inferentia instead of GPUs or CPUs.

Read the full story

Hugging Face Inference Optimization

Every AI story that matters — and the intelligence behind it.

Wednesday, 16 March 2022

Image search with 🤗 datasets

Accelerate BERT inference with Hugging Face Transformers and AWS Inferentia

Every AI story that matters, in your inbox by 8am.

Every AI story that matters,
in your inbox by 8am.