Three.js Developer – Real-Time 3D LLM Avatar Integration

About Us:

RobotBulls is a cutting-edge fintech startup building the next generation of decentralized automated trading platforms. We fuse AI, big data, and blockchain to reshape the future of trading. We're now venturing into a unique intersection of AI and real-time 3D interaction—and we’re looking for a talented Three.js Developer to bring it to life.

The Role:

We’re building a web-based, ChatGPT-like experience—but with a face. A 3D avatar that speaks, reacts, and expresses itself in real time, powered by an existing LLM (like GPT), STT/TTS pipelines, and a fully rigged 3D model. Your job: glue it all together using Three.js.

What You’ll Do:

• Integrate an existing 3D facial model (blendshapes/facial rig) with real-time LLM outputs

• Handle real-time lip sync and facial expressions synced with TTS-generated audio

• Build a smooth pipeline between STT (speech-to-text), LLM (text generation), and TTS (text-to-speech)

• Connect and sync the avatar’s responses with animated visuals in the browser using Three.js

• Ensure seamless communication between frontend (3D avatar) and backend AI systems

• Optimize rendering and animation performance for smooth real-time interactions

• Troubleshoot complex syncing and animation timing issues

• Collaborate with AI engineers, designers, and backend devs to bring the avatar to life

Requirements:

• 3+ years of experience with Three.js and WebGL

• Strong understanding of real-time 3D rendering in the browser

• Experience working with 3D facial rigs, blendshapes, and morph targets

• Familiarity with animation systems and audio sync (lip movement, emotions)

• Solid grasp of STT/TTS integration (e.g., Whisper, ElevenLabs, etc.)

• Ability to interface with LLM APIs (OpenAI, etc.)

• Proficiency in JavaScript, WebSockets, REST APIs

• Understanding of performance optimization and cross-browser compatibility

• Comfortable working in fast-paced, experimental environments

Bonus Points:

• Experience with facial motion capture or real-time facial tracking

• Background in character animation or VFX

• Familiarity with WebRTC for real-time communication

• Prior work with avatars, digital humans, or conversational UI/UX

• Knowledge of shaders and custom rendering techniques in Three.js

Perks:

• Competitive salary + performance bonuses

• Fully remote with flexible hours

• Creative freedom on a cutting-edge AI x 3D project

• Work with a team of builders, creators, and innovators