Happy New Year!

A very happy New Year to all for 2025!

Just a quick note to say that I'm not starting one of my periodic blogging holidays. The New Year and then starting work again afterwards has been quite busy, so I've not had much time to continue with my readthrough of Sebastian Raschka's book "Build a Large Language Model (from Scratch)". I was hoping to get some done this weekend, but personal commitments got in the way.

I have had some downtime, but just enough to read some fiction -- I'm rereading Connie Willis's excellent "Oxford Time Travel" series, out of order -- I started with the wonderfully whimsical "To Say Nothing of the Dog", and am now most of the way through the significantly less cheerful but deeply moving "Doomsday Book".

I'm also having a lengthy pair of on-and-off discussions with Claude and ChatGPT o1 about the history of attention mechanisms, so hopefully when I get back to the LLM book I'll be better prepared :-)