Backend Software Engineer#

👋 I’m Cedric Chee. I’ve been a software engineer, writer, and entrepreneur.

I code and write about it sometimes. I create system softwares and apps in Go/JS.

I do product engineering and web development at startups/consulting. I enjoy backend development.

I’m currenly focusing on Large Language Models (LLMs). I tinker with LLMs and AI systems at night.

Read more on the about page →

Recent Posts

GPT-4o: HER Went From Science Fiction to Reality

The new advanced voice and video mode is groundbreaking! Audio AI models are having their Stable Diffusion moment too.

Voice AI Research

Make computers talk like human. My attempts and some notes about them, along the way.

AI Agent UX

Augmentation is composed of smaller automations. AI helps generate levels of abstraction.

Generative AI Engineering

Things to consider when building apps with foundation models. Evals, evals, evals.

State of GPT 2023

Text version of Karpathy's State of GPT 2023 presentation.

Tradeoffs Between Long-Context LLM and RAG

From Claude 100K to Gemini 10M, we are in the era of long-context LLMs. Long context will replace RAG?

Evaluating Llama 3 on Code Tasks

We evals 100+ publicly available LLMs on code tasks. Llama-3-70b-Instruct performed better than open-source, code-specific LLMs and outperformed Claude-3-Opus.

The Intuition behind Rotary Positional Embedding (RoPE)

Explain RoPE in a way that a non-technical person can understand.

Meta releases Llama 3 Large Language Models (LLMs) 🦙

Llama 3 sets a new standard for state-of-the art performance and efficiency for openly available LLMs.

Rebutting Devin: "First AI Software Engineer" Claim is Not True

Generative AI is cool, but demos around it should be honest and transparent.

AI Agents and Agentic Behavior

What is AI agents? Agentic? and 2025 will be the year of agentic AI.

Early Thoughts on Large Language Models

Personal perspective of ChatGPT (and similar) models, and where we stand with respect to language understanding.

What Defines an Advanced AI Coding Assistant?

The potential of AI pair-programming tools improving software development.

A First Look at Bun 1.0

Speedrun Bun first production release and Bun vs Deno.

What Is Software Engineering?

3 critical differences between programming and software engineering: time, scale, and the trade-offs at play. Software engineering is programming integrated over time. Programming is about producing code. Software engineering extends that to include the maintenance of that code for its useful life span.

Software Enshittification

A generation is lost. We don't know how to build software that lasts for decades. Schools hardly teach that anymore.

Leaked System Prompts

LLMs cannot keep a secret. Prompt leak is not hallucination.

Llama2.c — The rise of micro-LLMs

The smaller and better language model paradigm, Karpathy's Llama2.c, and Microsoft Phi-1.

What I've Learned in 45 Years in the Software Industry

Software craftmanship and engineering wisdom.

Creating a chatbot using Alpaca native and LangChain

Talk to an Alpaca-7B model using LangChain with a conversational chain and a memory window.