staticnotes.org

Don't fall into the anti-AI hype

Tue, 13 Jan 2026 10:00:00 +0000

A post shared by antirezthat resonated with me (as of January 2026). LLMs, even with no future performance improvements, are here to stay and will fundamentally change the jobs of people that write or interact with code. Not using them for a majority of tasks will be like using C for data science analyses, rather than higher-level abstractions.

To add to his post, I think that LLM+human will still outperform LLM-only for most complex work especially within legacy architectures for the next years.

I also hope he is right with his generally positive sentiment about the future:

How do I feel, about all the code I wrote that was ingested by LLMs? I feel great to be part of that, because I see this as a continuation of what I tried to do all my life: democratizing code, systems, knowledge. LLMs are going to help us to write better software, faster, and will allow small teams to have a chance to compete with bigger companies. The same thing open source software did in the 90s.

link: https://antirez.com/news/158

Lunch with the FT: Yann LeCun (paywall)

Sat, 03 Jan 2026 19:00:00 +0000

This week the Lunch with the FT is with Yann LeCun. It’s an interesting conversation in a (very expensive) Parisian restaurant.

I didn’t know that LeCun worked at AT&T Bell Labs in the 1980s and 1990s where he had access to the resources to play with convolutional neural networks.

In 2013 he became Meta’s Chief AI scientist, apparently under the conditions that he could retain his academic position at NYU and work from there and that all the research at FAIR is made publicly available. According to him he also was the main person to push for the open-weight strategy of the Llama models.

They also chat about the reasons why he left Meta in 2025. It sounds like a typical research vs. product story. He wanted to move away from the LLM-approach whereas Zuckerberg wanted to focus on their Llama models which led to the team rushing out the disappointing Llama 4 model. After that a lot of researchers left FAIR and Meta acqui-hired Alexandr Wang(Scale AI) as the Chief AI officer. Leading the new Meta Superintelligence Labs he continue to focus on productizable LLM-based models.

Meanwhile LeCun reemphasizes that LLMs won’t be able to achieve superintelligence because text as training data is too limiting for their learning. He believes that architectures like V-JEPA, called world models, are much more likely to achieve superintelligence. Those models are learning from the physical world via video and spatial data. He thinks that the new fundamental research labs, Mira Murati’s Thinking Machines and Sutskever’s Safe Superintelligence, are a better way to work on these new architectures than the frontier model companies.

link: https://www.ft.com/content/e3c4c2f6-4ea7-4adf-b945-e58495f836c2

The Ridiculous Engineering Of The World's Most Important Machine

Sat, 03 Jan 2026 14:00:00 +0000

This is such a well-produced video by one of my favorite youtube channels, Veritasium. The video explains ASML’s 17-year long quest to build a EUV (Extreme Ultraviolet) lithography machine. The R&D cost for this project were €6 billion and the project was close to be shut down on multiple occasions.

They are the most complex (commercial) machines built to date. They use 13.5nm EUV light to print 3nm–5nm process nodes onto modern chips. This allows for example TSMC to manufacture the latest Apple M5 chip (3nm architecture).

The technical challenges ASML had to overcome to get the lithography process to work at this precision are mind boggling. For example, to create the EUV light, they are shooting a laser at 50,000 molten tin droplets per second. This creates plasma hotter than the sun, which then emits the light at the required wavelength.

The video also sheds light (pun intended) onto one of ASML’s partners, Carl Zeiss SMT , which manufactures the absurdly clean and smooth optical elements of the machine.

It will be interesting to see what will happen in the next years. Currently ASML is the only company that can manufacture these EUV lithography machines. Their TWINSCAN NXE:3800E machine can produce chips with 2nm logic nodes. ASML is not allowed to export their machines to China. However, It has been reported a few weeks ago that a research team in Shenzen has built a working prototype for EUV lithography. The research team consists of former ASML engineers who helped reverse engineer some of the components. The goal of the project is to produce working chips from this prototype between 2028-2030.

link: https://www.youtube.com/watch?v=MiUHjLxm3V0

Senior engineers should make side bets

Sat, 03 May 2025 16:00:00 +0000

Sean Goedecke verbalized something I had on my mind for quite some time, but couldn’t put into words. Every tech team has certain tech issues or high-impact projects that will not be worked on because

the feasibility of the project is unclear
the costs of not working on the project are unknown to all but one or a few people
the project involves using a technology that few or nobody has experience of or is aware of.

Sean calls these projects potential side bets. Senior Engineers or Sr Data Scientists are best positioned to identify and bet on these projects by dedicating some of their time to them (10–20%).

This doesn’t mean everyone should start working on random projects. Instead a successful side bet should have concrete benefits. Moreover, if you want to be an impactful senior engineer a certain % of the bets should succeed. This idea reminds me of “having good research taste” as discussed in Hamming’s “You and your research” essay.

link: https://www.seangoedecke.com/side-bets/

Understanding Solar Energy

Fri, 21 Mar 2025 20:00:00 +0000

Interesting post from the great blog Construction Physics on the evolution of solar energy cost in the last 20 years, and what that means for solar’s role as an alternative way of powering your home.

An interesting point is that the cost of powering your home doesn’t increase linearly with the % of solar used in your electricity mix. If you target to use solar for 90% of your electricity, it will cost you much more than 2x the cost of targeting to use solar for 45% of your electricity. This is because you need to either overbuild capacity or provide extra storage to cover times of lower solar yield.

However, if the cost of PV modules (and ideally installation) keeps decreasing at a similar pace, this becomes less and less of an issue.

link: https://www.construction-physics.com/p/understanding-solar-energy/

via: https://marginalrevolution.com/marginalrevolution/2025/03/friday-assorted-links-513.html

Here’s how I use LLMs to help me write code

Wed, 12 Mar 2025 10:00:00 +0000

One of the best ways to become a more effective user of LLMs is to watch other people use them. An eye-opener for me was this post by Nicholas Carlini.

Some useful snippets from Simon Willison’s LLM usage guide:

The best way to start any project is with a prototype that proves that the key requirements of that project can be met. I often find that an LLM can get me to that working prototype within a few minutes of me sitting down with my laptop—or sometimes even while working on my phone.

I could write this function myself, but it would take me the better part of fifteen minutes to look up all of the details and get the code working right. Claude knocked it out in 15 seconds. I find LLMs respond extremely well to function signatures like the one I use here. I get to act as the function designer, the LLM does the work of building the body to my specification.

I often wonder if this is one of the key tricks that people are missing—a bad initial result isn’t a failure, it’s a starting point for pushing the model in the direction of the thing you actually want.

I’ve been vibe-coding since before Andrej gave it a name! My simonw/tools GitHub repository has 77 HTML+JavaScript apps and 6 Python apps, and every single one of them was built by prompting LLMs. I have learned so much from building this collection, and I add to it at a rate of several new prototypes per week.

And this is similar to something I wrote before:

I’m certain it would have taken me significantly longer without LLM assistance—to the point that I probably wouldn’t have bothered to build it at all. This is why I care so much about the productivity boost I get from LLMs so much: it’s not about getting work done faster, it’s about being able to ship projects that I wouldn’t have been able to justify spending time on at all.

link: https://simonwillison.net/2025/Mar/11/using-llms-for-code/

How Core Git Developers Configure Git

Tue, 25 Feb 2025 14:02:17 +0000

Interesting discussion of git config options that the git core developers favor and that are not (yet) defaults. There are some nice suggestions. For example, I didn’t know that

git config --global push.autoSetupRemote true

existed. If you haven’t defined an upstream for a branch yet, git will automatically set it for you. So you don’t have to run

git push --set-upstream origin my-branch-name

anymore.

Some other options I adopted from this post:

# sort branches by last committed date
$ git config --global branch.sort -committerdate 
# sort tags by tag-number not alphabetically
$ git config --global tag.sort version:refname   
# better diff algorithm than the default myers
$ git config --global diff.algorithm histogram
# color moved code differently than added code in diffs
$ git config --global diff.colorMoved plain
# push branch to same-named remote
$ git config --global push.default simple
# attempt to autocorrect misspelled git commands in the cli
$ git config --global help.autocorrect prompt 
# add the diff to the commit message draft
$ git config --global commit.verbose true
# 3-way-diffing
$ git config --global merge.conflictstyle zdiff3

link: https://blog.gitbutler.com/how-git-core-devs-configure-git/

via: https://news.ycombinator.com/item?id=43169435

Brandon Sanderson on Building a Fiction Empire

Sun, 23 Feb 2025 22:00:00 +0000

This is an interesting podcast conversation with Brandon Sanderson that I came across accidentally (I enjoyed particularly the parts from [00:37:57] onwards). He is the author of The Stormlight Archive and Mistborn fantasy novels. I have read The Way of Kings some years ago but didn’t yet continue the series.

A couple of interesting things he discussed:

He publishes and distributes his books via his company, Dragonsteel, and uses successful kickstarter campaigns to finance new projects. Kickstarter is quite common for board games or video games projects, but not many people have used it for successful book projects.
He develops and tests his books like a Hollywood studio would test movie ideas. For example, his team developed an elaborate test reader process to understand whether they understand and/or like certain parts of a book. I find it interesting how he walks the fine line between writing about what he likes and writing for the market and commercial success.
He explains that ebook and audiobook deals are hard to negotiate when the market is dominated by amazon / audible.
He can easily deconstruct popular books into common narrative patterns, e.g. Three-act-structure or The Hero’s journey .
I found his distinction between hard magic systems (magic rules are explicitly laid out to the reader, e.g. Asimov series) and soft magic systems (rules are vague, and reader or characters will develop surprising new capabilities, e.g. Gandalf in Lord of the Rings) fascinating.

link: https://www.youtube.com/watch?v=wIgI_DiwZh4

via: https://tim.blog/2025/02/05/brandon-sanderson/

Using S3 triggers to maintain a list of files in DynamoDB

Thu, 20 Feb 2025 15:58:31 +0000

“Getting from a rough idea to a working proof of concept of something like this with less than 15 minutes of prompting is extraordinarily valuable. This is exactly the kind of project I’ve avoided in the past because of my almost irrational intolerance of the frustration involved in figuring out the individual details of each call to S3, IAM, AWS Lambda and DynamoDB.”

This describes exactly why I think that the current generation of models is already immensely valuable. There are a range of technologies and frameworks that would deliver me value if I would spend the time to adapt them to my use case. Normally this would involve a lot of googling and reading forum posts that only describe my problem to 80%. Having an LLM to guide you in the right direction, lowers the bar and time investment enough to allow much easier and quicker experimentation.

A LLM-generated proof-of-concept, followed by understanding the solution, and then a refining is what works for me. I used it to implement changes on this blog (don’t know much about Hugo), building simple apps at work (with retool), debugging package errors (homebrew, pyenv), etc.

link: https://til.simonwillison.net/aws/s3-triggers-dynamodb

Stuff you should have been taught in college but weren't

Sat, 08 Feb 2025 18:30:00 +0000

Casey Handmer’s perspective on how to think about your job and career, especially relevant for people transitioning into tech after a PhD/Postdoc:

“It’s not enough to have mastered your job to get moved up. You also have to build trust with your management. It doesn’t matter how good you are at the mechanics of your job, if your management and colleagues don’t trust you, they’ll see you as a loose cannon and try to find ways to offboard you. I have been in this position before – and clueless about it. My job was saved because I had become critical infrastructure for too much of the system, but I was still marginalized and unable to advance, because I had broken (spectacularly!) the trust of management.”

link: https://caseyhandmer.wordpress.com/2025/02/04/stuff-you-should-have-been-taught-in-college-but-werent/

via: https://www.thediff.co/archive/longreads-open-thread-113/

Developer philosophy

Mon, 03 Feb 2025 22:00:00 -0001

A couple of senior developer best practices that I can relate to, especially:

“Avoid, at all costs, arriving at a scenario where the ground-up rewrite starts to look attractive.”

and

“Nobody cares about the golden path. Edge cases are our entire job. Think about ways in which things can fail. Think about ways to try to make things break.”

link: https://qntm.org/devphilo

via: https://news.ycombinator.com/item?id=42920285

What fully automated firms will look like

Sat, 01 Feb 2025 17:11:00 +0000

I am at least sceptical that the current LLM approach will allow the necessary step change in capability, autonomy, and robustness. However, it is fun to read about hypotheses how future companies will look like:

“Everyone is sleeping on the collective advantages AIs will have, which have nothing to do with raw IQ but rather with the fact that they are digital—they can be copied, distilled, merged, scaled, and evolved in ways human simply can’t.

What would a fully automated company look like - with all the workers, all the managers as AIs? I claim that such AI firms will grow, coordinate, improve, and be selected-for at unprecedented speed.”

I find it more practical to think about how to position yourself in a world where certain aspects of your job are already automatible, i.e. the skills are available in the training dataset and they can be verified as right or wrong. This is discussed here .

link: https://www.dwarkeshpatel.com/p/ai-firm

via: https://marginalrevolution.com/marginalrevolution/2025/01/the-wisdom-of-dwarkesh.html

Life Lessons from the First Half-Century of My Career

Sun, 26 Jan 2025 12:00:00 +0000

I think most people (that get to choose) know deep down about the major things they need to do to be more productive, have a more fulfilling career and family life. Nevertheless, it’s always interesting to see other people’s focuses and learnings. I agree with most of them.

link: https://cacm.acm.org/opinion/life-lessons-from-the-first-half-century-of-my-career/

via: https://news.ycombinator.com/item?id=42795646

The One Good Reason to Become a Manager (and All the Bad Ones)

Wed, 22 Jan 2025 16:46:00 +0000

I agree with this blog post on good (impact, leverage, vision) and bad (money, status, growth) reasons for becoming a manager. Nicely put together and I like the style of the blog.

link: https://terriblesoftware.org/2024/12/05/the-one-good-reason-to-become-a-manager-and-all-the-bad-ones/

I've been advocating for RSS support, and you should too

Sat, 18 Jan 2025 10:00:00 -0500

I am a big fan of the decentralized and simple nature of RSS. I am using the Feeder RSS app which means I can curate a feed of interesting content without an algorithm having to push content on me.

link: https://reedybear.bearblog.dev/ive-been-advocating-for-rss-support-and-you-should-too/

via: https://news.ycombinator.com/item?id=42746222

Quoting gwern

Sat, 18 Jan 2025 10:00:00 -0500

“[…] much of the point of a model like o1 is not to deploy it, but to generate training data for the next model. Every problem that an o1 solves is now a training data point for an o3 (eg. any o1 session which finally stumbles into the right answer can be refined to drop the dead ends and produce a clean transcript to train a more refined intuition).”

- gwern

link: https://www.lesswrong.com/posts/HiTjDZyWdLEGCDzqu/implications-of-the-inference-scaling-paradigm-for-ai-safety?commentId=MPNF8uSsi9mvZLxqz

via: https://simonwillison.net/2025/Jan/16/gwern/

Link blog in a static site

Thu, 16 Jan 2025 10:00:00 -0500

I wanted to add a link blog section to this blog since some time. This article gave me the motivation to do it. It took me roughly 2 hours with the support of claude to add this functionality and design to this page. I roughly follow the design/ideas in My approach to running a link blog .

link: https://rednafi.com/misc/link_blog/

via: https://news.ycombinator.com/item?id=42642625