Extended Reality
Practical guides on WebXR development, immersive applications, and open-source XR tooling — built on browser standards, self-hosted infrastructure, and sovereign technology.
WebXR Series (June 2026)
WebXR Hand Tracking — From Joints to Gestures — A practical deep-dive into the WebXR Hand Tracking API: joint positions, pinch detection, custom gesture recognition, and interaction patterns for immersive VR.
WebXR Anchors & Plane Detection — World-locked content with anchors, plane detection, persistent anchors across sessions, and robust placement UX.
WebXR Composition Layers — High-Performance Rendering — GPU-composited layers for video, UI, and background: projection, quad, cylinder, and equirectangular layers with XRMediaBinding.
WebXR Hit Testing & Depth Sensing — Ray intersection, transient hit tests, depth buffer reading, occlusion rendering, and mesh reconstruction for real-world interaction.
Building a WebXR App with Three.js — End-to-end guide from Vite scaffold to deployed production app: session lifecycle, controller input, teleportation, VR UI, and deployment.
AI + XR Integration Patterns — Practical patterns for integrating LLMs, VLMs, and neural networks with immersive XR environments: scene understanding, spatial assistants, neural rendering, and voice-first interfaces.
XR Performance: Real-Time Inference Optimization — Optimizing AI inference for XR devices: model quantization, NPU acceleration, hierarchical serving (device → edge → cloud), bandwidth optimization, and offloading frameworks for real-time 60fps rendering.
Earlier Articles
Running a WebXR Demo Instance — Getting started with browser-based VR and AR using the WebXR API. Hosted demo instance at tobias-weiss.org.
Projects
An open, interactive, and immersive learning platform for chemistry education. Features Molekülstudio (interactive 3D molecular visualization in VR), Mozilla Hubs integration for collaborative virtual classrooms, and interdisciplinary VR research in educational settings.
Technologies & Tools
- WebXR API — Browser-based VR/AR
- Three.js — 3D graphics for the web
- A-Frame — WebVR framework
- Mozilla Hubs — Social VR platform
- Unity3D — Game engine for VR/AR applications
- Unreal Engine — High-fidelity XR development
Want to see more? Check out my research work.