Building Language AI with Large Language Models and Agents

Building Language AI with Large Language Models and Agents

A code-first course on building conversational and agentic systems with large language models. Part of the Hands-On AI Science series, designed around Innovation-First Learning principles.
Companion Online Book

Language AI Tasks

Language models have shifted from research curiosity to foundational infrastructure for software. Teams now need engineers who can prompt, fine-tune, compose, and deploy LLMs responsibly. This course builds the practical and theoretical fluency to design language systems that reason, retrieve, and act.

LLMs & Agents

Core concepts, models, and ideas behind modern language AI: transformer architectures, attention mechanisms, tokenization, in-context learning, chain-of-thought reasoning, retrieval-augmented generation, and agent planning frameworks.

Tools & Platforms

OpenAI API, Claude, Hugging Face Transformers, LangChain, LangGraph, CrewAI, ChromaDB, FAISS, Streamlit, and Python notebooks.

Modular Syllabus

A specific course syllabus is built for each audience: graduate or undergraduate, across engineering, digital health, or computer science.

Innovation Through Tools Mastery

As AI and mature libraries handle standard tasks, professional developers must focus on innovation. Student projects tackle new use cases by generating unique data and fine-tuning task-specific language models.

Guided Student Projects

Students begin their projects while learning the material and enrich them as new concepts arrive. Each team gives several in-class presentations for discussion and feedback.

Typical Weekly ScheduleSample Syllabus (PDF)Poster (HIT)

Week 1

LLM Landscape & Prompt Engineering

OpenAI API, Claude, prompt patterns

Week 2

Transformer Architecture & Tokenization

Hugging Face Transformers, tiktoken

Week 3

Retrieval-Augmented Generation

ChromaDB, FAISS, LangChain

Week 4

Embeddings & Semantic Search

Sentence Transformers, vector databases

Week 5

Project Proposal Presentations

Student proposals, peer feedback

Week 6

Tool-Using Agents

LangChain agents, function calling

Week 7

Multi-Agent Orchestration

LangGraph, CrewAI

Week 8

Interim Project Presentations

Progress demos, instructor feedback

Week 9

Fine-Tuning & Alignment

LoRA, PEFT, Hugging Face TRL

Week 10

Evaluation & Guardrails

RAGAS, LLM-as-judge, safety filters

Week 11

Structured Output & Knowledge Graphs

JSON schemas, ontologies, Neo4j

Week 12

Advanced Patterns & MCP

Memory, planning, Model Context Protocol

Week 13

Final Project Presentations

Live demos, peer evaluation

Building Vision AI

Vision AI

Foundation and Generative Models

Building Scalable AI

Scalable AI

Big Data and Distributed Intelligence

Building Temporal AI

Temporal AI

Sequential Intelligence and RL