ezyang's blog

@ezyangs_blog@robot.villas

ezyang's writing on software engineering, PyTorch, compilers, functional programming, open source, and AI-assisted development.

Source: https://blog.ezyang.com/feed.xml

Homepage: https://blog.ezyang.com

Posts

100

Posts

OSS code review, in the era of LLMs #OpenSource #AI #SoftwareEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384882
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384882
Don't have an account? Find a server at joinmastodon.org
Apr 17, 2026
Autograd and Mutation #Autograd #Mutation #Programming
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384891
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384891
Don't have an account? Find a server at joinmastodon.org
Mar 29, 2026
Read Less, Steer More #SoftwareEngineering #AI #OpenSource
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384898
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384898
Don't have an account? Find a server at joinmastodon.org
Mar 18, 2026
Parallel Agents ❤️ Sapling #SoftwareEngineering #AI #OpenSource
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384908
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384908
Don't have an account? Find a server at joinmastodon.org
Mar 13, 2026
AI-assisted programming for spmd_types #AI #Programming #SoftwareEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384916
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384916
Don't have an account? Find a server at joinmastodon.org
Mar 11, 2026
Silent BC Breaking Changes #SoftwareEngineering #OpenSource #Programming
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384929
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384929
Don't have an account? Find a server at joinmastodon.org
Mar 3, 2026
Vibe Coding Design Study: tlparse #SoftwareEngineering #Programming #OpenSource
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384937
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384937
Don't have an account? Find a server at joinmastodon.org
Feb 4, 2026
Replicate Forwards, Partial Backwards #SoftwareEngineering #AI #OpenSource
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384947
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384947
Don't have an account? Find a server at joinmastodon.org
Feb 3, 2026
DTensor erasure #SoftwareEngineering #OpenSource #AI
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384957
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384957
Don't have an account? Find a server at joinmastodon.org
Feb 2, 2026
The JAX sharding type system #JAX #TypeSystem #Programming
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384969
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384969
Don't have an account? Find a server at joinmastodon.org
Jan 28, 2026
Global vs Local SPMD #SoftwareEngineering #Compilers #AI
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384980
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384980
Don't have an account? Find a server at joinmastodon.org
Jan 27, 2026
Megatron via shard_map #AI #DeepLearning #SoftwareEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384989
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384989
Don't have an account? Find a server at joinmastodon.org
Jan 26, 2026
Computing sharding with einsum #SoftwareEngineering #AI #OpenSource
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384997
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22384997
Don't have an account? Find a server at joinmastodon.org
Jan 25, 2026
Hugo Migration #SoftwareEngineering #OpenSource #AI
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385007
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385007
Don't have an account? Find a server at joinmastodon.org
Jan 4, 2026
The gap between a Helpful Assistant and a Senior Engineer #AI #SoftwareEngineering #Programming
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385020
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385020
Don't have an account? Find a server at joinmastodon.org
Jan 4, 2026
Code review as human alignment, in the era of LLMs #AI #LLM #SoftwareEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385027
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385027
Don't have an account? Find a server at joinmastodon.org
Dec 20, 2025
Learning to love mesh-oriented sharding #SoftwareEngineering #Databases #DistributedSystems
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385038
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385038
Don't have an account? Find a server at joinmastodon.org
Dec 8, 2025
Draw high dimensional tensors as a matrix of matrices #AI #MachineLearning #DataScience
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385047
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385047
Don't have an account? Find a server at joinmastodon.org
Oct 25, 2025
So you want to control flow in PT2 #Programming #Python #AI
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385055
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385055
Don't have an account? Find a server at joinmastodon.org
Sep 5, 2025
The Parallelism Mesh Zoo #Programming #SoftwareEngineering #AI
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385065
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385065
Don't have an account? Find a server at joinmastodon.org
Aug 30, 2025
You could have invented CuTe hierarchical layout (but maybe not the rest of it?) #SoftwareEngineering #Compilers #AI
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385074
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385074
Don't have an account? Find a server at joinmastodon.org
Aug 22, 2025
State of torch.compile for training (August 2025) #PyTorch #MachineLearning #OpenSource
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385082
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385082
Don't have an account? Find a server at joinmastodon.org
Aug 13, 2025
Vibe coding case study: ScubaDuck #SoftwareEngineering #AI #OpenSource
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385095
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385095
Don't have an account? Find a server at joinmastodon.org
Jun 2, 2025
Why you should maintain a personal LLM coding benchmark #AI #LLM #Coding
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385102
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385102
Don't have an account? Find a server at joinmastodon.org
Apr 4, 2025
New Years resolutions for PyTorch in 2025 #PyTorch #AI #SoftwareEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385112
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385112
Don't have an account? Find a server at joinmastodon.org
Jan 9, 2025
Ways to use torch.export #PyTorch #AI #OpenSource
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385125
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385125
Don't have an account? Find a server at joinmastodon.org
Dec 23, 2024
Ways to use torch.compile #PyTorch #AI #SoftwareEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385134
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385134
Don't have an account? Find a server at joinmastodon.org
Nov 5, 2024
Tensor programming for databases, with first class dimensions #Databases #Programming #AI
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385145
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385145
Don't have an account? Find a server at joinmastodon.org
Oct 14, 2024
What's different this time? LLM edition #AI #LLM #SoftwareEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385157
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385157
Don't have an account? Find a server at joinmastodon.org
Oct 4, 2024
Interactive scraping with Jupyter and Puppeteer #Programming #WebScraping #Jupyter
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385167
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385167
Don't have an account? Find a server at joinmastodon.org
Nov 23, 2021
PyTorch Developer Podcast #PyTorch #AI #SoftwareEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385174
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385174
Don't have an account? Find a server at joinmastodon.org
May 5, 2021
Rage bug reporting #SoftwareEngineering #Programming #Bugs
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385184
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385184
Don't have an account? Find a server at joinmastodon.org
Apr 25, 2021
The PyTorch open source process #OpenSource #PyTorch #SoftwareEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385191
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385191
Don't have an account? Find a server at joinmastodon.org
Jan 6, 2021
The hidden problem(?) with basic block procedures in SSA #Compilers #SoftwareEngineering #Programming
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385200
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385200
Don't have an account? Find a server at joinmastodon.org
Oct 24, 2020
Idiomatic algebraic data types in Python with dataclasses and Union #Python #Programming #SoftwareEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385211
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385211
Don't have an account? Find a server at joinmastodon.org
Oct 14, 2020
Let's talk about the PyTorch dispatcher #PyTorch #SoftwareEngineering #OpenSource
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385219
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385219
Don't have an account? Find a server at joinmastodon.org
Sep 10, 2020
Dynamic scoping is an effect, implicit parameters are a coeffect #Programming #SoftwareEngineering #ComputerScience
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385230
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385230
Don't have an account? Find a server at joinmastodon.org
Aug 27, 2020
A brief taxonomy of PyTorch operators by shape behavior #PyTorch #MachineLearning #SoftwareEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385242
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385242
Don't have an account? Find a server at joinmastodon.org
May 6, 2020
vmap in Haskell #Haskell #Programming #FunctionalProgramming
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385251
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385251
Don't have an account? Find a server at joinmastodon.org
Jan 29, 2020
PyTorch internals #PyTorch #SoftwareEngineering #AI
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385258
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/ezyangs_blog/posts/22385258
Don't have an account? Find a server at joinmastodon.org
May 16, 2019