The new advanced voice and video mode is groundbreaking! Audio AI models are having their Stable Diffusion moment too.

Make computers talk like human. My attempts and some notes about them, along the way.

Augmentation is composed of smaller automations. AI helps generate levels of abstraction.

Things to consider when building apps with foundation models. Evals, evals, evals.

Text version of Karpathy's State of GPT 2023 presentation.

From Claude 100K to Gemini 10M, we are in the era of long-context LLMs. Long context will replace RAG?

We evals 100+ publicly available LLMs on code tasks. Llama-3-70b-Instruct performed better than open-source, code-specific LLMs and outperformed Claude-3-Opus.

Explain RoPE in a way that a non-technical person can understand.

Llama 3 sets a new standard for state-of-the art performance and efficiency for openly available LLMs.

Generative AI is cool, but demos around it should be honest and transparent.

What is AI agents? Agentic? and 2025 will be the year of agentic AI.

Personal perspective of ChatGPT (and similar) models, and where we stand with respect to language understanding.

The potential of AI pair-programming tools improving software development.

Speedrun Bun first production release and Bun vs Deno.

3 critical differences between programming and software engineering: time, scale, and the trade-offs at play. Software engineering is programming integrated over time. Programming is about producing code. Software engineering extends that to include the maintenance of that code for its useful life span.

A generation is lost. We don't know how to build software that lasts for decades. Schools hardly teach that anymore.

LLMs cannot keep a secret. Prompt leak is not hallucination.

The smaller and better language model paradigm, Karpathy's Llama2.c, and Microsoft Phi-1.

Software craftmanship and engineering wisdom.

Talk to an Alpaca-7B model using LangChain with a conversational chain and a memory window.