Executive TL;DR:
- Apple’s Sharp model runs in the browser using ONNX Runtime Web.
- The model allows for single-image 3D Gaussian splatting.
- It has potential privacy benefits as it runs locally on the client-side.
The Buzz Score:
The Internet’s Verdict: 70% Hyped, 30% Skeptical
Forum Voices
Developers are experimenting with Apple’s Sharp model in the browser. One developer says:
I vibecoded a simple web app using Sharp that allowed be to quickly browse any local image folder and view them as ‘almost’ volumetric 3d scenes in a VR headset.
Another developer notes the potential of running AI models in the browser:
Nice, I’ve also been doing some similarly neat things via ONNX web… I think all-client-side in-browser AI imagery is becoming very doable and has lots of privacy benefits.
Technical Details
The Sharp model is a single-image 3D Gaussian splatting model. It was exported to ONNX and run via onnxruntime-web with the WebGPU EP.
However, some users have reported issues with the model, including high memory usage:
Loading the model crashes my browser tab from memory usage.
Focus Keyword: Sharp Browser