Systems in Practice · Library

Writing

Articles, notes, and guides on the systems behind data and AI.

25 items · newest first

Jul 05, 2026Guide

Data System Design Interview Glossary

The core concepts and tradeoffs used in data-platform architecture interviews.

Data platforms Engineering practice

Jul 05, 2026Guide

Study Guide: Data Operations Architecture at Scale

A study guide to ingestion, enrichment, quality, governance, and operations at scale.

Data platforms AI & ML systems

Jul 05, 2026Guide

Agentic Systems Design Interview — Concept Glossary

A reference to requirements, architecture, and operational concepts for agentic systems.

AI & ML systems Engineering practice

Jul 04, 2026Guide

Study Guide: The Nemotron 3 Super Data Engineering Pipeline

A structured reference to the stages and tradeoffs in the Nemotron pretraining data pipeline.

AI & ML systems Data platforms

Jul 01, 2026Article

Inside Nemotron 3 Super: The Data Engineering Behind a 25-Trillion-Token Model

Examining the data preparation behind the Nemotron 3 Super pretraining corpus.

AI & ML systems Data platforms

Jun 30, 2026Article

The Data Operations Cycle

The connected systems that acquire, validate, enrich, serve, and monitor production ML data.

Data platforms AI & ML systems

Jun 27, 2026Article

Building a Multimodal Feature Store for Product Quality Risk: A Data-First Journey

Building a product-quality feature store, from raw reviews to serving and drift monitoring.

AI & ML systems Databases & querying

Jun 27, 2026Article

Batch, Streaming, and Merged Views in ML Data Operations

How batch and streaming paths combine into consistent views for machine learning.

Data platforms AI & ML systems

Jun 23, 2026Article

Machine Learning System Design: A Comprehensive Guide to Data-Centric Feature Stores

Designing the ingestion, serving, and monitoring systems behind production feature stores.

AI & ML systems Data platforms

Jun 21, 2026Article

Explaining the Multimodal Lakehouse in Interviews

Explaining a multimodal system through its constraints, design choices, and failure modes.

Engineering practice

Jun 18, 2026Article

Training-Ready Multimodal Data: Shards and Loaders

Turning immutable dataset manifests into WebDataset shards and efficient training loaders.

AI & ML systems Data platforms

Jun 18, 2026Article

From Search Demo to Data Infrastructure

Precomputation, provenance, and observability turn a search demo into dependable data infrastructure.

Data platforms Engineering practice

Jun 18, 2026Article

Eval Feedback Loops for Multimodal Dataset Versions

Using evaluation feedback to decide whether a new dataset version deserves promotion.

AI & ML systems

Jun 15, 2026Article

What Comes Next for the Multimodal Lakehouse

The next design questions for a multimodal lakehouse: quality, deduplication, and evaluation.

AI & ML systems Data platforms

Jun 12, 2026Article

Ray Actors, Catalog Trust Boundaries, and Pipeline Battle Scars

Ray actors, GPU execution, and the catalog boundary in a distributed multimodal pipeline.

Distributed systems Databases & querying

Jun 11, 2026Article

Scaling ETL Pipelines: From One Machine to Distributed Systems

Moving from single-machine ETL to distributed pipelines without losing correctness or control.

Distributed systems Data platforms

Jun 11, 2026Article

Multimodal Lakehouse Implementation Notes

Content-addressed storage, dataset versioning, and deduplication in a multimodal lakehouse.

Databases & querying Data platforms

Jun 03, 2026Article

Why 8 Python Threads Can Still Use Only 1 Core

Why CPU-bound Python threads stall, and when processes are the better tool.

Distributed systems Engineering practice

Jun 01, 2026Article

Serverless Multimodal Data Lakehouse

A 12-stage pipeline for turning text, images, video, and audio into traceable training data.

Data platforms AI & ML systems

Apr 30, 2021Article

DATA PIPELINE ORCHESTRATION

Orchestrating a batch analytics pipeline with Airflow, AWS EMR, and Redshift.

Data platforms

Jan 29, 2021Article

Anomaly Detection in Electricity Consumption

Finding unusual electricity consumption patterns with time-series analysis and machine learning.

AI & ML systems

Oct 02, 2020Article

An End-to-End Machine Learning Web App

Building and serving a computer-vision model for recognizing amenities in property photos.

AI & ML systems

Sep 27, 2020Article

M5 - Forecasting - Part-III

Comparing forecasting approaches for retail product demand across stores and states.

AI & ML systems

Sep 26, 2020Article

M5 - Forecasting - Part-II

Examining seasonality and time-series patterns in retail sales before building forecasts.

AI & ML systems

Sep 25, 2020Article

M5 - Forecasting - Part-I

Exploring the M5 retail dataset through product demand, prices, stores, and sales patterns.

AI & ML systems