←
Bytebytego2,287 posts
Bytebytego avatar

Bytebytego

@bytebytego

Weekly system design topics you can read in 10 mins.

◷ Joined March 2022▧ 721 Photos and videos
Bytebytego avatar
Bytebytego@bytebytego·16 Jul 2024

The Big Archive for System Design - 2023 Edition (PDF) is available now. And it's completely FREE. The PDF contains 𝐚𝐥𝐥 𝐦𝐲 𝐭𝐞𝐜𝐡𝐧𝐢𝐜𝐚𝐥 𝐩𝐨𝐬𝐭𝐬 published in 2023. What’s included in the PDF? 🔹 Netflix's Tech Stack 🔹 Top 5 common ways to improve API performance 🔹 Linux boot Process Explained 🔹 CAP, BASE, SOLID, KISS, What do these acronyms mean? 🔹 Explaining JSON Web Token (JWT) to a 10 year old Kid 🔹 Explaining 8 Popular Network Protocols in 1 Diagram 🔹 Top 5 Software Architectural Patterns 🔹 OAuth 2.0 Flows 🔹 What does API gateway do? 🔹 Linux file system explained 🔹 18 Key Design Patterns Every Developer Should Know 🔹 Best ways to test system functionality 🔹 Top 6 Load Balancing Algorithms 🔹 Top 12 Tips for API Security 🔹 𝐀𝐧𝐝 100+ 𝐦𝐨𝐫𝐞 – Like, follow and subscribe to our newsletter to receive the PDF download link: bit.ly/3KCnWXq

Post attachment
Alex Xu avatar
⟳ Bytebytego retweeted
Alex Xu@alexxubyte·21h

Docker vs Kubernetes

Post attachment
Alex Xu avatar
⟳ Bytebytego retweeted
Alex Xu@alexxubyte·Nov 14

Join ByteByteGo’s FREE live masterclass: “Don’t Build AI Agents Without Learning These Techniques.” More than 2,500 people have already registered. Join now before the seats fill up. 📅 Sunday, Nov 15 🕛 12 PM PT · 1 hour 💻 Live on Zoom Register for free: live.bytebytego.com/mastercl…

Post attachment
Alex Xu avatar
⟳ Bytebytego retweeted
Alex Xu@alexxubyte·Nov 10

Kubernetes Explained for Busy Engineers

Post attachment
Alex Xu avatar
⟳ Bytebytego retweeted
Alex Xu@alexxubyte·Nov 9

How LinkedIn Uses AI to Review 40,000 Pull Requests a Week

Post attachment
Alex Xu avatar
⟳ Bytebytego retweeted
Alex Xu@alexxubyte·Nov 5

How a SQL Query Executes Inside a Database

Post attachment
Alex Xu avatar
⟳ Bytebytego retweeted
Alex Xu@alexxubyte·Nov 4

6 frequently used orchestration frameworks in an AI system

Post attachment
Alex Xu avatar
⟳ Bytebytego retweeted
Alex Xu@alexxubyte·Oct 28

It's been 7 years from GPT-2 to GPT-6, and a lot has changed. The diagram below shows each generation and its key highlights, based on the public information we know. GPT-2 (2019): More like a prototype to validate the potential of the decoder-only transformer. This was a 1.5B-parameter model that only went through pre-training with next-token prediction. The trained model was only capable of continuing text, not answering questions. GPT-3 (2020): The same recipe as GPT-2, just much bigger and trained on more data to test how far scale alone could go. GPT-3 had 175B parameters, more than 100 times the size of GPT-2, and still only went through pre-training. The scale allowed it to show in-context learning capabilities. When shown some examples, the model could follow them. GPT-4 (2023): On top of pre-training, OpenAI fine-tuned it with RLHF (reinforcement learning from human feedback), so it was not just a completion model but could actually answer questions. It was also multimodal, meaning that it could process input images as well as text, and it handled up to 32K tokens of context. GPT-5 (2025): The first GPT generation with built-in reasoning. Given a prompt, tools, and an effort level, the trained model could generate reasoning tokens before the answer. Its context window grew to 400K tokens, with a router in ChatGPT to decide when a prompt needed thinking mode. GPT-6 (2026): This new model has a bigger context window (1.05M), supports async tool calling, and is generally safer. An interesting feature, called mid-turn steering, is that it can take a new instruction while it's thinking.

Post attachment
Alex Xu avatar
⟳ Bytebytego retweeted
Alex Xu@alexxubyte·Oct 22

5 AI Building Blocks Every Engineer Should Know - LLMs - Embedding Models - RAG - Agent Harnesses - World Models

5:15
Alex Xu avatar
⟳ Bytebytego retweeted
Alex Xu@alexxubyte·Oct 21

Understanding the Linux Directory Structure

Post attachment
Alex Xu avatar
⟳ Bytebytego retweeted
Alex Xu@alexxubyte·Oct 20

OAuth (authorization) + OIDC (authentication layer)

Post attachment
Alex Xu avatar
⟳ Bytebytego retweeted
Alex Xu@alexxubyte·Oct 14

Google Translate: The Ideas Behind Neural Translation A simplified illustration of common techniques. Not an exact map of Google Translate’s current system.

Post attachment