← Back to home
GitHub Repo

rasbt/LLMs-from-scratch

Jupyter Notebook · Star 105K · Fork 16.1K · 2026-09-15

Source & License

Author: rasbt

This site lists project metadata and a short summary only. We do not republish the author’s original content — follow the source link above for the full text. Verify the LICENSE and NOTICE in the original repository before commercial use.

Introduction

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Author:rasbt
Language:Jupyter Notebook
Star:105K
Fork:16.1K
Tags
aiartificial-intelligenceattention-mechanismdeep-learningfinetuningfrom-scratchgenerative-aigptinstruction-tuninglanguage-modellarge-language-modelsllmmachine-learningnatural-language-processingpretrainingpythonpytorchtokenizertransformers

Information boundary

Information on this page is collected from official documents for technical presentation only and does not imply our endorsement. Pricing, quotas and availability are subject to the latest official statements. We make no commitment regarding any action you take after leaving this site.

What is an Open Source Project

An open source project is complete software with publicly available source code, typically hosted on GitHub. Unlike skills, it provides runnable programs, documentation and installation steps, suitable for users who need to self-deploy or customize. StackPilot curates high-quality open source repositories ranked by popularity and activity.