ALL LESSONSWEEK 49THURSDAY

CONNECT · SYSTEM DESIGN + CAPSTONE

SQLite and indexes

How far can one machine go?30–60 MINUTESCORE + PRACTICAL
01

GROUND

Problem

What becomes confusing, fragile, or impossible without understanding SQLite and indexes? This lesson answers that through explanation, a worked example, two runnable exercises, and a reference solution. No teacher-supplied worksheet is required.

Distributed architectures address concrete capacity, reliability, and coordination limits—but often arrive before those limits do.
02

LEARN

Concept explanation

SQLite and indexes belongs to “How far can one machine go?”. SQLite and indexes must be connected to layer below by tracing representation, ownership, control, and failure. One-machine design starts with requirements and estimates, then locates first real bottleneck.

For SQLite and indexes, trace concrete input, state transition, output, and failure through an architecture decision tied to explicit requirements, estimates, state ownership, failure modes, and measured limits.

Start with requirements and estimates, choose the smallest architecture, locate its first bottleneck, then evolve one measured constraint at a time. Apply that model to supplied normal, boundary, and failure cases; each case below names its input and expected evidence.

Observable

Evidence produced by the SQLite and indexes experiment: output, state, trace, bytes, timing, or diagnostics.

Invariant

Condition that must remain true while inputs or implementation of SQLite and indexes change.

Boundary

Point where SQLite and indexes crosses ownership, representation, time, process, network, or trust.

Example bank

Compare normal, boundary, failure, and cross-layer cases. Predict each observation before revealing the explanation.

Baseline · one variable

SETUPTrace SQLite and indexes end-to-end while running: Design URL shortener in one process with SQLite and explicit backup.

OBSERVETrace explains Every component traces to requirement; capacity math and load test identify first bottleneck. without skipping any conversion, queue, process, protocol, or storage boundary.

WHY IT MATTERSThis isolates the normal contract of SQLite and indexes; preserve its raw evidence as the control for every later comparison.

Boundary · same contract, harder input

SETUPAt every SQLite and indexes boundary, label owner and representation during: Estimate 10× traffic/storage and index size.

OBSERVERecord what remains invariant and the first representation, owner, size, or timing value that changes in Architecture notebook · load tests · traces · Git history.

WHY IT MATTERSA boundary example is useful only when one named dimension changes and everything else stays comparable.

Failure · evidence before repair

SETUPLocate first layer where evidence diverges during: Crash during write and document recovery procedure.

OBSERVECapture the first divergence from the baseline, including exact input, diagnostic, state, and recovery result. Expected recovery: Trace explains Every component traces to requirement; capacity math and load test identify first bottleneck. without skipping any conversion, queue, process, protocol, or storage boundary.

WHY IT MATTERSThe diagnostic is part of the interface. Repair the proven cause, not the most visible symptom.

Cross-layer · follow ownership

SETUPTrace SQLite and indexes one layer below its usual abstraction through an architecture decision tied to explicit requirements, estimates, state ownership, failure modes, and measured limits.

OBSERVETrace requests, state ownership, capacity, queues, caches, replication, failure domains, recovery, operational load, and cost.

WHY IT MATTERSThe lower layer is earned when it explains evidence the current layer cannot. Otherwise keep SQLite and indexes at the simpler boundary.

03

SEE

Worked example

Start from supplied design.md. Focus: Trace SQLite and indexes end-to-end while running: Design URL shortener in one process with SQLite and explicit backup.

  1. Run: Fill design.md, then verify every component traces to one stated requirement or measured constraint.
  2. Save baseline evidence. Trace requests, state ownership, capacity, queues, caches, replication, failure domains, recovery, operational load, and cost.
  3. Boundary case: At every SQLite and indexes boundary, label owner and representation during: Estimate 10× traffic/storage and index size.
  4. Failure case: Locate first layer where evidence diverges during: Crash during write and document recovery procedure.
RESULT
Trace explains Every component traces to requirement; capacity math and load test identify first bottleneck. without skipping any conversion, queue, process, protocol, or storage boundary. Starter-level baseline: Document names one action, target, non-goal, numeric estimate, state owner, request path, bottleneck, and recovery procedure.
04

START HERE

Starter material

PREREQUISITESA plain-text editor, Git, and tools named by the weekly slice. Start from a blank directory.

ONE-TIME SETUPmkdir reforging-capstone && cd reforging-capstone && git init

Create design.md, paste this exact content, then run the command below.

# SQLite and indexes

## Requirements
- One primary user action:
- One reliability target:
- One explicit non-goal:

## Estimate
- Requests/second:
- Stored bytes/day:
- Peak concurrent work:

## Smallest design
- State owner:
- Request path:
- First bottleneck:
- Recovery procedure:
RUNFill design.md, then verify every component traces to one stated requirement or measured constraint.

STOP / CLEANUPStop any process started by your slice with Ctrl+C; run git status before leaving.

05

DO WITH GUIDANCE

Guided exercise

Trace layer below: SQLite and indexes

  1. Normal case: Trace SQLite and indexes end-to-end while running: Design URL shortener in one process with SQLite and explicit backup.
  2. Write predicted evidence from this named case before running starter.
  3. Label input, state owner, transformation, output, and failure at every boundary.
  4. Run exact normal case. Save commands, inputs, outputs, and diagnostics in notebook.
  5. Explain changed evidence using lesson mental model in no more than five sentences.
Concrete guided solution
  1. Copy the supplied design.md unchanged and run: Fill design.md, then verify every component traces to one stated requirement or measured constraint.
  2. Write this prediction before inspecting output: Trace explains Every component traces to requirement; capacity math and load test identify first bottleneck. without skipping any conversion, queue, process, protocol, or storage boundary.
  3. Perform only the named normal case: Trace SQLite and indexes end-to-end while running: Design URL shortener in one process with SQLite and explicit backup.
  4. Save the raw output, then annotate input → transition → evidence. Use Architecture notebook · load tests · traces · Git history to confirm the transition rather than inferring it.
  5. Compare prediction with evidence; if they differ, keep both and write the rule that explains the difference. Reference baseline: Document names one action, target, non-goal, numeric estimate, state owner, request path, bottleneck, and recovery procedure.
06

DO ALONE

Independent exercise

Remove one abstraction: SQLite and indexes

  1. Create second case from blank file: At every SQLite and indexes boundary, label owner and representation during: Estimate 10× traffic/storage and index size.
  2. Then create controlled failure: Locate first layer where evidence diverges during: Crash during write and document recovery procedure.
  3. Use Architecture notebook · load tests · traces · Git history to prove behavior, then repair controlled failure.
  4. Compare result against supplied acceptance checks and reference approach before marking complete.
Concrete independent solution
  1. Duplicate the starter into a clean comparison case; change only this boundary: At every SQLite and indexes boundary, label owner and representation during: Estimate 10× traffic/storage and index size.
  2. Save its evidence beside the baseline and identify the first changed value. Trace requests, state ownership, capacity, queues, caches, replication, failure domains, recovery, operational load, and cost.
  3. Create the exact controlled failure: Locate first layer where evidence diverges during: Crash during write and document recovery procedure.
  4. Draw five columns: input, representation, owner, transition, evidence.
  5. Run baseline and add one row whenever SQLite and indexes changes owner or representation: Design URL shortener in one process with SQLite and explicit backup.
  6. Repeat with boundary case and mark unchanged versus changed rows: Estimate 10× traffic/storage and index size.
  7. Trigger failure and stop at first divergent row: Crash during write and document recovery procedure.
  8. Repair that row’s cause, rerun trace, and confirm: Every component traces to requirement; capacity math and load test identify first bottleneck.
  9. Rerun baseline, boundary, and repaired failure together. Accept only if all reproduce: Trace explains Every component traces to requirement; capacity math and load test identify first bottleneck. without skipping any conversion, queue, process, protocol, or storage boundary.
07

COMPARE

Expected result

  • Trace explains Every component traces to requirement; capacity math and load test identify first bottleneck. without skipping any conversion, queue, process, protocol, or storage boundary.
  • Document names one action, target, non-goal, numeric estimate, state owner, request path, bottleneck, and recovery procedure.
  • Controlled SQLite and indexes failure produces captured evidence; repair restores stated invariant without hiding error.
08

PROVE

Acceptance checks

Lesson is complete only when every check is true. Each check is stored locally and travels with your JSON backup.

0/5 complete · saved on this device

09

UNSTICK

Hints

Reveal hints
  1. Start with supplied normal case exactly as written: Trace SQLite and indexes end-to-end while running: Design URL shortener in one process with SQLite and explicit backup.
  2. For boundary case, change only named dimension: At every SQLite and indexes boundary, label owner and representation during: Estimate 10× traffic/storage and index size.
  3. If result is confusing, diff raw inputs and evidence before editing implementation.
  4. If tool shows nothing useful, move observation one boundary lower: representation, runtime, OS, or network.
10

VERIFY

Solution

Attempt both exercises before opening reference approach.

Reveal reference solution
  1. Run unmodified starter and preserve baseline evidence: Document names one action, target, non-goal, numeric estimate, state owner, request path, bottleneck, and recovery procedure.
  2. Draw five columns: input, representation, owner, transition, evidence.
  3. Run baseline and add one row whenever SQLite and indexes changes owner or representation: Design URL shortener in one process with SQLite and explicit backup.
  4. Repeat with boundary case and mark unchanged versus changed rows: Estimate 10× traffic/storage and index size.
  5. Trigger failure and stop at first divergent row: Crash during write and document recovery procedure.
  6. Repair that row’s cause, rerun trace, and confirm: Every component traces to requirement; capacity math and load test identify first bottleneck.
11

PREDICT · INSPECT · BREAK · DEBUG · MEASURE

Interrogate reality

Prediction: write expected output, state transition, ordering, and failure evidence before running either exercise.

Inspection: Trace requests, state ownership, queues, caches, replication lag, failure domains, cost, and recovery procedures.

Measurement: Estimate traffic, storage, latency, throughput, availability, consistency windows, operational load, and cost.

INSPECT

Capture raw evidence before explaining.

BREAK

Change one assumption and force controlled failure.

DEBUG

Find cause with Architecture notebook · load tests · traces · Git history before editing fix.

TOOL DRILL · keyboard only · record one retrievable command or shortcut
12

MASTERY + FRONTIER + BOUNDARY

Own the knowledge

TEACH

Explain SQLite and indexes at beginner, intermediate, and senior depth.

REBUILD

Recreate smallest useful example from blank file without notes or AI.

RETRIEVE

Schedule recall for day 1, 7, 30, and 90.

Creative frontier lab

Try first without opening the solutions. The constraints invite invention; the reference gives one concrete direction, never the only valid answer.

Constraint inversion

Re-solve SQLite and indexes by removing the most convenient abstraction. delete one service and recover the requirement with the smallest capable layer.

CONSTRAINTKeep the same inputs, observable result, and failure evidence; change the means, not the contract.

ORIGINAL IDEATurn subtraction into a design tool: the missing abstraction should reveal which responsibility it used to hide.

Reveal frontier solution
  1. Freeze the contract as three fixtures: Trace SQLite and indexes end-to-end while running: Design URL shortener in one process with SQLite and explicit backup. / At every SQLite and indexes boundary, label owner and representation during: Estimate 10× traffic/storage and index size. / Locate first layer where evidence diverges during: Crash during write and document recovery procedure.
  2. List every convenience used by the starter; remove the highest-level one while preserving Fill design.md, then verify every component traces to one stated requirement or measured constraint..
  3. Implement the smallest replacement using delete one service and recover the requirement with the smallest capable layer.
  4. Run all fixtures and compare raw evidence. Keep the simpler version unless the removed abstraction has a demonstrated benefit.
Representation x-ray

Build an explanation artifact for SQLite and indexes: trace each component to a requirement, estimate, owner, failure domain, and observable signal.

CONSTRAINTA peer must be able to locate the first divergence without reading implementation code.

ORIGINAL IDEATreat the explanation itself as a product: make invisible transitions visible, replayable, and diffable.

Reveal frontier solution
  1. Create one row or timestamped event for each transition in: Trace SQLite and indexes end-to-end while running: Design URL shortener in one process with SQLite and explicit backup.
  2. For every row record input, representation, owner, operation, output, and tool evidence from Architecture notebook · load tests · traces · Git history.
  3. Replay At every SQLite and indexes boundary, label owner and representation during: Estimate 10× traffic/storage and index size.; highlight only changed rows.
  4. Replay Locate first layer where evidence diverges during: Crash during write and document recovery procedure.; stop at the first divergent row and attach its recovery action.
Adversarial remix

Combine the boundary and failure into a new user-visible scenario for SQLite and indexes. turn a failure drill into a user-visible recovery story with explicit invariants.

CONSTRAINTDo not merely add more input. Invent a recovery interaction, alternate representation, or self-checking behavior.

ORIGINAL IDEAMake the system teach its own limits: the artifact should expose the invariant and offer a safe next action when it breaks.

Reveal frontier solution
  1. Combine these two pressures without changing them: At every SQLite and indexes boundary, label owner and representation during: Estimate 10× traffic/storage and index size. AND Locate first layer where evidence diverges during: Crash during write and document recovery procedure.
  2. Name the invariant that must survive and the user-visible evidence when it cannot: Trace explains Every component traces to requirement; capacity math and load test identify first bottleneck. without skipping any conversion, queue, process, protocol, or storage boundary.
  3. Implement this original direction: turn a failure drill into a user-visible recovery story with explicit invariants.
  4. Demonstrate baseline, combined failure, recovery, then baseline again; save the sequence as a regression fixture.

Capability frontier

Push SQLite and indexes until another layer becomes justified. Record one robust technique, one contextual trade-off, and one labeled hack or historical curiosity.

CORE · PRACTICAL · CONTEXTUAL · HACK · FRAGILE · HISTORICAL · GOLF

Boundary

No diagram removes physics, coordination, product ambiguity, or operational responsibility.

If this vanished tomorrow…

Collapse toward one process, one machine, files, SQLite, explicit protocols, and manual recovery until the true minimum appears.

Why next layer is earned

The next layer is another year of rebuilding, publishing, source reading, and measured production work.