Skip to main content Link Menu Expand (external link) Left Arrow Right Arrow Document Search Copy Copied

Workshop Title Slide

Build Your Own Chatbot: Local Applications n Generative AI on Your Laptop (Winter 2026)

Most people know cloud-based generative AI tools like ChatGPT, but did you know that the powerful technology behind them—transformer-based Large Language Models (LLMs)—can also run directly on a modern laptop?

In this hands-on, in-person workshop, you’ll explore how these AI systems work and learn how to set up and run a basic chatbot locally on your own computer. Gain a foundational understanding of transformer-based LLMs and discover how to harness their power without relying on the cloud.

By the end of this session, participants will be able to:

  • Understand the core principles behind transformer-based large language models
  • Set up and run a basic chatbot AI on a personal laptop
  • Explore practical applications and limitations of locally hosted generative AI

This session is perfect for anyone curious about AI who wants to experiment with running models independently!

Workshop Preparation and Technology Requirements

Required technology and setup

Please make sure you have a laptop that meets the following requirements:

  • 8GB of memory or greater (might work with 4GB but no guarantees)
  • Running an up to date version of Linux, MacOS, or Windows

Important notes

  • Devices like iPads and Chromebooks are not supported. You are welcome to attend, but will need to follow along with another person.
  • If you intend to use a Mac***, be sure to install the XCode Command Line Tools before the session.

Pre-workshop data download

If possible in advance of the workshop, please download this model file to the computer you will use during the workshop.

  • On Windows, rename the downloaded file to “Qwen3.5-0.8B-Q8_0.exe”
  • On Mac, open a terminal window, cd to the directory where you’ve downloaded the file, and run “chmod 755 Qwen3.5-0.8B-Q8_0.llamafile”

Important Notes

  • This is a relatively large file (1.7 GB), so only download using an appropriate internet connection. You may need to resume the download if it halts partway through.
  • If you cannot download the file in advance of the workshop, please arrive at the workshop 10 minutes early to download from a USB drive.

Facilitator Bio

John Fink is the Digital Scholarship Librarian in the Sherman Centre.

Workshop Slides

Coming soon.