TLDRocket
Sign in

Hugging Face

120 summarised stories about Hugging Face, each linking back to the original source. Browse all topics →

Thursday, 1 February 2024

Patch Time Series Transformer in Hugging Face

Hugging Face Blog 2 years ago

PatchTST, a time series forecasting model based on Transformers, was added to Hugging Face with documentation showing how to train and apply it to electricity data using transfer learning. The model divides time series into patches of configurable length (the example uses patch_length=16 with context_length=512) and reduces computational complexity quadratically compared to processing full sequences. Users can now train PatchTST directly on datasets, perform zero-shot forecasting on new domains, and fine-tune pretrained models using the Hugging Face Trainer API.

Hugging Face Text Generation Inference available for AWS Inferentia2

Hugging Face Blog 2 years ago

Hugging Face Text Generation Inference became generally available on AWS Inferentia2 through Amazon SageMaker for deploying large language models in production. The solution supports popular models like Llama and Mistral, with pre-compiled configurations cached for batch size 2-4 and sequence length 2048 to avoid the 45-minute compilation process. Customers can now deploy LLMs on Inferentia2 as a cost-effective alternative to GPUs, with deployment taking 10-15 minutes on ml.inf2.8xlarge instances.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads 60+ sources, removes duplicate coverage, and summarises the day in two minutes. Free, no spam, unsubscribe anytime.