Chat with AI assistant running locally in your browser powered by WebGPU. This project is currently under development and supports document editing assistance on Overleaf. More features are planned.

Getting Started

1. Install Dependencies

Using your preferred JavaScript package manager to install the dependencies.

npm install
# or
yarn
# or
pnpm install

2. Build the Project

npm run build
# or
yarn build
# or
pnpm run build

3. Install the Chrome extension

Launch Google Chrome and navigate to the extensions page by entering chrome://extensions. Enable Developer Mode by clicking the toggle switch next to Developer mode. Click the Load unpacked button and select the dist directory.

Links

• You might want to check out our online public Machine Learning Compilation course for a systematic walkthrough of our approaches.
• WebLLM is a companion project using MLC LLM's WebGPU and WebAssembly backend.
• WebStableDiffusion is a companion project for diffusion models with the WebGPU backend.
• Icons from FlatIcon