Browser-based LLM Playground

Welcome to this lightweight LLM playground! Chat with a small but capable AI model that runs entirely in your browser.

Step 1: Initialize WebLLM and Download Model

Press the Download button to initialize WebLLM and download the SmallThinker-3B-Preview model directly in your browser. The model will be cached in your browser, so you won't need to download it again on future visits.

Step 2: Chat