Baike.dev
All toolsOnline toolsAI codingTrendingOpen sourceNewsSubmit
Log in
< Back to tools
U

ultron-by-sagar-builds

> 编程语言
Open source

Ultron.

389 stars0 likes1 views
WebsiteGitHub

About

Ultron.

ULTRON Orb UI

An Iron Man–inspired holographic orb built with Next.js, Three.js, and MediaPipe hand tracking — control it with your bare hands through your webcam.

This is the open-source interface of ULTRON — my AI that talks in real time and controls Android devices by itself. Read the write-up or the X post

Watch the demo on Instagram

https://github.com/user-attachments/assets/91578a83-9a27-44e8-84b0-96defcfd7366

Getting started

bash
npm install
npm run dev

Open http://localhost:3000.

Controls

Mouse / touch

Input Action
Drag Spin the orb
Scroll / pinch Zoom in & out

Hand gestures (webcam)

Click GESTURES OFF (or press G) and allow camera access, then:

Gesture Action
Pinch (thumb + index) one hand and move it Spin the orb
Pinch with both hands, spread apart / bring together Zoom in / out

Keyboard

Key Action
G Toggle hand gestures
R Reset the view
+ / − Zoom in / out

How it works

  • lib/orbScene.ts — the Three.js scene: layered wireframe shells, a spiral inner core, floating code-text sprites, orbiting debris, dust particles, scan rings, and a bloom + chromatic-aberration post-processing stack.
  • lib/handTracker.ts — MediaPipe HandLandmarker running on the webcam feed. Pinch detection with hysteresis: one pinched hand spins the orb, two pinched hands zoom by spreading apart or together.
  • components/JarvisOrb.tsx — the HUD and glue between the scene, the tracker, and your inputs.

License

MIT

Issues· 0 open

View all issuesOpen on GitHub

No open issues yet, or sync has not completed.

> Tags

TypeScript

No comments yet. Be the first to share.

> Details

PublishedAug 1, 2026
UpdatedSep 17, 2026
Category编程语言
PricingOpen source

> Related tools

T
TypeScript
JavaScript 的超集,为前端与全栈提供静态类型
P
Python
通用编程语言,广泛用于 Web、数据与 AI
G
Go
Google 推出的简洁高效系统语言