Experimenting with the proposed Cross-Origin Storage API in Transformers.js
The article explores the challenge of efficiently caching large AI model resources in web applications, particularly in the context of the Transformers.js library. It highlights that current caching mechanisms, which isolate resources by origin, lead to redundant downloads of shared files like the Wasm runtime. The Cross-Origin Storage (COS) API addresses this by using a cryptographic hash to uniquely identify resources, preventing duplication and improving performance. The API allows apps to store files with precise control over visibility and integrity, enabling secure and privacy-preserving caching. Transformers.js is piloting the COS API to reduce redundant downloads and enhance performance.
More from Huggingface
LFM2.5-VL-3B for Better and Faster Vision Capabilities for the Edge
Thinking of ACE? We Can Do It with Fewer Tokens
Meta is back with Muse Glimmer: local, agentic, multimodal, and open source
