The new advanced voice and video mode is groundbreaking! Audio AI models are having their Stable Diffusion moment too.
Backend Software Engineer#
👋 I’m Cedric Chee. I’ve been a software engineer, writer, and entrepreneur.
I code and write about it sometimes. I create system softwares and apps in Go/JS.
I do product engineering and web development at startups/consulting. I enjoy backend development.
I’m currenly focusing on Large Language Models (LLMs). I tinker with LLMs and AI systems at night.
Recent Posts
Voice AI Research
Make computers talk like human. My attempts and some notes about them, along the way.
AI Agent UX
Augmentation is composed of smaller automations. AI helps generate levels of abstraction.
Generative AI Engineering
Things to consider when building apps with foundation models. Evals, evals, evals.
State of GPT 2023
Text version of Karpathy's State of GPT 2023 presentation.
Tradeoffs Between Long-Context LLM and RAG
From Claude 100K to Gemini 10M, we are in the era of long-context LLMs. Long context will replace RAG?
Evaluating Llama 3 on Code Tasks
We evals 100+ publicly available LLMs on code tasks. Llama-3-70b-Instruct performed better than open-source, code-specific LLMs and outperformed Claude-3-Opus.
The Intuition behind Rotary Positional Embedding (RoPE)
Explain RoPE in a way that a non-technical person can understand.
Meta releases Llama 3 Large Language Models (LLMs) 🦙
Llama 3 sets a new standard for state-of-the art performance and efficiency for openly available LLMs.
Rebutting Devin: "First AI Software Engineer" Claim is Not True
Generative AI is cool, but demos around it should be honest and transparent.
AI Agents and Agentic Behavior
What is AI agents? Agentic? and 2025 will be the year of agentic AI.
Early Thoughts on Large Language Models
Personal perspective of ChatGPT (and similar) models, and where we stand with respect to language understanding.
What Defines an Advanced AI Coding Assistant?
The potential of AI pair-programming tools improving software development.
A First Look at Bun 1.0
Speedrun Bun first production release and Bun vs Deno.
What Is Software Engineering?
3 critical differences between programming and software engineering: time, scale, and the trade-offs at play. Software engineering is programming integrated over time. Programming is about producing code. Software engineering extends that to include the maintenance of that code for its useful life span.
Software Enshittification
A generation is lost. We don't know how to build software that lasts for decades. Schools hardly teach that anymore.
Leaked System Prompts
LLMs cannot keep a secret. Prompt leak is not hallucination.
Llama2.c — The rise of micro-LLMs
The smaller and better language model paradigm, Karpathy's Llama2.c, and Microsoft Phi-1.
What I've Learned in 45 Years in the Software Industry
Software craftmanship and engineering wisdom.
Creating a chatbot using Alpaca native and LangChain
Talk to an Alpaca-7B model using LangChain with a conversational chain and a memory window.