H Company Releases NeoMME: A Family of 260M and 800M Single-Tower Multimodal Encoders That Drop the Vision Tower and Causal Decoder
MarkTechPost 1 month ago 34
H Company released NeoMME, a 260M/800M single-tower multimodal encoder family that removes both the separate vision tower and the causal decoder used in many production-style retrievers. The 260M NeoMME-Retriever reaches 0.523 nDCG@10 on ViDoRe v3, while the model indexes 51.3 pages per second on a single NVIDIA L40S and the checkpoint is available under Apache 2.0 on Hugging Face. As a result, retrieval indexing storage is cut from about 1.5 MB to 39.0 kB per page (with factor-10 pooling and int8) and the models can be deployed without day-one integration work in Transformers.