Engineering at scale: The blueprint for building high-volume scoring engines featuring Saurabh Kumar
Tech Funding News Abhinaya Prabhu
Walmart Global Tech engineer Saurabh Kumar redesigned a high-volume scoring system to remove a monolithic bottleneck. The update cut P99 latency by over 50%. It decoupled scoring into its own microservice and used Java fine-grained parallelism to score multiple items at once, plus it later enabled faster ML deployments and a rebuilt A/B testing platform.
Why it matters
Large e-commerce platforms face a technical bottleneck: they need to score millions of items instantly without delays. The…