/LAM_WebRender

A lightweight WebGL Render for LAM and LAM_Audio2Expression

Primary LanguageTypeScriptMIT LicenseMIT

LAM_WebRender ๐ŸŽจ

Lightweight WebGL Renderer - Real-time 3D Gaussian Splatting Render Engine for LAM and LAM_Audio2Expression.

Our rendering engine is now available as an NPM package.


๐Ÿš€ Getting Started

  1. Install dependencies

    npm install
  2. Run development server

    npm run dev
  3. Open in browser

http://localhost:5173/

๐Ÿ“ฆ Core Features

โœจ Key Highlights

  • Real-time rendering support: Interactive LAM avatars with LAM_Audio2Expression facial animations
  • NPM package integration: Use with npm install gaussian-splat-renderer-for-lam

๐Ÿ“ฆ NPM Package Usage

Installation

npm install gaussian-splat-renderer-for-lam

Basic Usage Example

    import * as GaussianSplats3D from 'gaussian-splat-renderer-for-lam';
    const div = document.getElementById('GaussianRenderer');
    const assetPath = './asset/arkit/p2-1.zip'; //the real asset address
    const render = await GaussianSplats3D.GaussianSplatRenderer.getInstance(div, assetPath);

๐Ÿ’ก Advanced Features

  • Facial animations: Load /asset/test_expression_1s.json for expression control
  • Custom avatars: Generate new models via LAM and replace ZIP files

๐Ÿ”— Related Projects

copy

Feature Repository
Chat integration OpenAvatarChat
Avatar generation LAM
Expression generation LAM_Audio2Expression

๐Ÿ“บ Demo

The demo shows that LAM_Audio2Expression leverages audio input to generate ARKit blendshapes-driven facial expressions, powering ultra-realistic 3D avatars generated by LAM, and rendered with this render engine.

Gradio_Demo.mp4

The demo highlights a low-latency SDK for real-time interactive chat avatars, developed using the same rendering engine as the core framework.

Chat_Demo.mp4

๐Ÿงช Example Files

  • Avatar model: ./asset/arkit/p2-1.zip
  • Expression data: ./asset/test_expression_1s.json

๐Ÿ“œ License

This project is licensed under the MIT License.