Sebastian Raschka
LLM research engineer and author of Build a Large Language Model (From Scratch); formerly at Lightning AI
Sebastian Raschka is an LLM research engineer whose recent work, according to Raschka's site, centers on LLM architectures and small-scale training, with an interest in inference and evaluation. Raschka is the author of Build a Large Language Model (From Scratch) and its sequel, Build a Reasoning Model (From Scratch); the first book's official code repository implements, pretrains and fine-tunes a GPT-like model in PyTorch and is designed to run on conventional laptops. Raschka's site describes earlier roles as a senior engineer at Lightning AI and as a statistics professor at the University of Wisconsin-Madison.123
Work
LLMs-from-scratch (external site: github.com)Open-source code
Official code repository for Raschka's book Build a Large Language Model (From Scratch), containing code for developing, pretraining and fine-tuning a GPT-like LLM in PyTorch without external LLM libraries; the main chapter code is designed to run on conventional laptops. Licensed under Apache-2.0.341
Earlier roles
- Senior engineer, Lightning AI12
- Statistics professor, University of Wisconsin-Madison12
This profile covers public professional work only, from the sources below. It is not an endorsement or a ranking. To correct or remove it, use the correction form.