Navid MoazzezNavid Moazzez

Nn Zero To Hero

A course on neural networks that starts all the way at the basics. The course is a series of YouTube videos where we code and train neural networks together. The Jupyter notebooks we build in the videos are then captured here inside the lectures directory. Every lecture also has a set of exercises included in the video description. (This may grow into something more respectable). Backpropagation and training of neural networks. Assumes basic knowledge of Python and a vague recollection of calculus from high school. YouTube video lecture Jupyter notebook files micrograd Github repo We implement a bigram character-level language model, which we will further complexify in followup videos into a modern Transformer language model, like GPT. In this video, the focus is on (1) introducing torch.Tensor and its subtleties and use in efficiently evaluating neural networks and (2) the overall framework of language modeling that includes model training, sampling, and the evaluation of a loss (e.g. the negative log likelihood for classification). YouTube video lecture Jupyter notebook files makemore Github repo

View Nn Zero To Hero on GitHub
Navid Moazzezby Navid Moazzez·Updated Sept 30, 2026·1 min read
Nn Zero To Hero

A course on neural networks that starts all the way at the basics. The course is a series of YouTube videos where we code and train neural networks together. The Jupyter notebooks we build in the videos are then captured here inside the lectures directory. Every lecture also has a set of exercises included in the video description. (This may grow into something more respectable).

Backpropagation and training of neural networks. Assumes basic knowledge of Python and a vague recollection of calculus from high school. YouTube video lecture Jupyter notebook files micrograd Github repo

We implement a bigram character-level language model, which we will further complexify in followup videos into a modern Transformer language model, like GPT. In this video, the focus is on (1) introducing torch.Tensor and its subtleties and use in efficiently evaluating neural networks and (2) the overall framework of language modeling that includes model training, sampling, and the evaluation of a loss (e.g. the negative log likelihood for classification). YouTube video lecture Jupyter notebook files makemore Github repo

Nn Zero To Hero at a glance

Stars25k
Forks3.6k
LanguageJupyter Notebook
LicenseMIT
Last update2024-08-18
Contributors2

Where Nn Zero To Hero is listed

Navid Moazzez

AI business strategist & AI OS builder

Navid Moazzez helps creators and founders master AI and build their own AI Operating System (AI OS) to automate their business and life.

Navid.me is reader-supported. When you buy through links on this site, I may earn an affiliate commission. Learn more.

More free tools

Related MCP servers & CLIs

Free AI newsletter

The most actionable AI newsletter for founders

Every week, get proven AI strategies, curated tools, and step-by-step systems to grow your audience, create better content, and build a profitable creator business.

No fluff, no filler, no BS. Just five minutes each week that might level up your online business and life.

P.S. Sign up now to get free access to my ultimate AI tools guide for creators.

Loved by 10,000+ readers