Local Applications in Generative AI on your Laptop
Large Language Models (LLMs) are transforming how we interact with technology, but how do they actually work, and what does it take to run one yourself? This workshop provides a practical introduction to transformer-based AI models and demonstrates how generative AI can be run locally on your own computer without relying on cloud-based services. Through guided demonstrations and hands-on exploration, participants will learn the fundamentals of locally hosted AI and gain experience working with open-source language models.
By the end of this workshop, participants will be able to:
- Explain the core principles behind transformer-based large language models.
- Set up and run a basic chatbot using a locally hosted AI model on a personal computer.
- Identify the hardware and software requirements for running generative AI models locally.
- Evaluate the practical applications, benefits, and limitations of locally hosted AI systems.
- Explore opportunities for experimenting with open-source AI tools in research, teaching, and personal projects.
This session is ideal for students, researchers, instructors, and anyone curious about generative AI who wants to better understand how these systems work and experiment with running models independently. No prior AI experience is required.
Workshop Preparation
None
Facilitator Bio
John Fink is the Digital Scholarship Librarian in the Sherman Centre.
Workshop Slides
Coming soon.