ai-notes

My own notes on some AI/ML stuff that I've learned. Inspired by swyxio/ai-notes.

Introduction / overview

For motivation and inspiration.

• Andrew Ng's Opportunities in AI - 2023
• Andrej Karpathy's Intro to Large Language Models
• Jeremy Howard's A Hackers' Guide to Language Models
• Swyx's The 1,000x AI Engineer

DeepLearning.ai

• Short courses

Andrej Karpathy's videos

• [Playlist] Neural Networks: Zero to Hero

Jeremy Howard's Fast.AI courses

• Practical Deep Learning Part 1
• Practical Deep Learning Part 2: Deep Learning Foundations to Stable Diffusion

AI Engineer Workshops

• AI Engineering 101
• AI Engineering 201 Part 1: Running Inference
• AI Engineering 201 Part 2: The Rest of the Owl

Podcasts

• Latent Space: The AI Engineer Podcast

Topics

• Mixture of Experts (MoE)
• Representation Engineering (RepE)
• CM3Leon
• Reflexion
• Direct Preference Optimization (DPO)
• ReAct: Synergizing Reasoning and Acting in Language Models
• Self-Rewarding Language Models