Site Topics Fundamentals 2 in Practice: Lessons From Real Deployments

For queue design, the constraint matters more than the feature list. A queue smooths spikes but also hides how far behind you are. Teams working on queue design usually discover this the hard way. Retries without jitter turn a small outage into a large one. Separating the reads from the writes buys room to change either side. This is most visible in queue design.

Consider observability specifically. The interesting number is not the average, it is the 99th percentile. Observability: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Every abstraction you add is a place where behaviour can differ from intent. That applies to observability as well.

Teams working on access control usually discover this the hard way. You can often replace a coordination problem with an idempotency key. Anything that grows without a bound will eventually hit one. This is most visible in access control. Consider access control specifically. Documentation that is not tested tends to describe the previous version.

Backup Strategy: Serving static bytes is the cheapest thing you can do at the edge. Backup Strategy: A schema is an interface; changing it is a migration, not an edit. Backup Strategy: Track the denominator as carefully as the numerator.

Search Indexing: The interesting number is not the average, it is the 99th percentile. Search Indexing: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Search Indexing: Every abstraction you add is a place where behaviour can differ from intent.

Queue Design: If a metric has no owner, it will drift until it causes an incident. Queue Design: The cheapest optimisation is usually removing work nobody asked for. Queue Design: Aggregating at write time trades flexibility for predictable read cost.

Access Control: You can often replace a coordination problem with an idempotency key. Access Control: Anything that grows without a bound will eventually hit one. Access Control: Documentation that is not tested tends to describe the previous version.

Load Balancing: If a metric has no owner, it will drift until it causes an incident. Load Balancing: The cheapest optimisation is usually removing work nobody asked for. Load Balancing: Aggregating at write time trades flexibility for predictable read cost.

A design that cannot be rolled back is a design that cannot be changed safely. That applies to cost controls as well. In practice, cost controls behaves differently: Latency budgets are easier to defend when every hop has a stated ceiling. Caching helps only until the invalidation rules become the bottleneck. The same reasoning holds for cost controls.

Teams working on log analysis usually discover this the hard way. Serving static bytes is the cheapest thing you can do at the edge. A schema is an interface; changing it is a migration, not an edit. This is most visible in log analysis. Consider log analysis specifically. Track the denominator as carefully as the numerator.

You can often replace a coordination problem with an idempotency key. That applies to monitoring alerts as well. In practice, monitoring alerts behaves differently: Anything that grows without a bound will eventually hit one. Documentation that is not tested tends to describe the previous version. The same reasoning holds for monitoring alerts.

Monitoring Alerts: A queue smooths spikes but also hides how far behind you are. Monitoring Alerts: Retries without jitter turn a small outage into a large one. Monitoring Alerts: Separating the reads from the writes buys room to change either side.

For edge caching, the constraint matters more than the feature list. The first thing to settle is the failure mode, not the happy path. Teams working on edge caching usually discover this the hard way. Measurements taken once are anecdotes; you need a baseline that repeats. Costs usually concentrate in a small number of operations, so find those first. This is most visible in edge caching.

A design that cannot be rolled back is a design that cannot be changed safely. That applies to data pipelines as well. In practice, data pipelines behaves differently: Latency budgets are easier to defend when every hop has a stated ceiling. Caching helps only until the invalidation rules become the bottleneck. The same reasoning holds for data pipelines.

Consent is not a one-time permission that applies to everything that follows. Agreement to one activity does not automatically mean agreement to another, and consent on one occasion does not establish consent on a later occasion. People can set limits, ask to pause or change their minds at any point. The other person needs to respect that change without argument or pressure.

Consider monitoring alerts specifically. The interesting number is not the average, it is the 99th percentile. Monitoring Alerts: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Every abstraction you add is a place where behaviour can differ from intent. That applies to monitoring alerts as well.

Queue Design: Serving static bytes is the cheapest thing you can do at the edge. Queue Design: A schema is an interface; changing it is a migration, not an edit. Queue Design: Track the denominator as carefully as the numerator.

Listening is part of the conversation. Ask what the other person understands, and invite them to describe their own boundaries without treating the exchange as a negotiation in which every limit must be traded away. Open questions such as “What would help you feel comfortable?” can clarify expectations. If a question feels intrusive, either person can decline to answer it.

Consider access control specifically. Serving static bytes is the cheapest thing you can do at the edge. Access Control: A schema is an interface; changing it is a migration, not an edit. Track the denominator as carefully as the numerator. That applies to access control as well.

Cost Controls: Periodic jobs should be safe to run twice, because they will be. Cost Controls: You rarely need a new component to fix a boundary problem. Cost Controls: The signal you want is often already logged, just not aggregated.

Consider api design specifically. If the rollback plan needs a meeting, it is not a rollback plan. API Design: Small pages that stay small are easier to keep fast than large ones made fast. Write the invariant down; otherwise it lives only in someone's memory. That applies to api design as well.

Serving static bytes is the cheapest thing you can do at the edge. The same reasoning holds for observability. For observability, the constraint matters more than the feature list. A schema is an interface; changing it is a migration, not an edit. Teams working on observability usually discover this the hard way. Track the denominator as carefully as the numerator.

Storage Tiers: The first thing to settle is the failure mode, not the happy path. Storage Tiers: Measurements taken once are anecdotes; you need a baseline that repeats. Storage Tiers: Costs usually concentrate in a small number of operations, so find those first.

Monitoring Alerts: If the rollback plan needs a meeting, it is not a rollback plan. Monitoring Alerts: Small pages that stay small are easier to keep fast than large ones made fast. Monitoring Alerts: Write the invariant down; otherwise it lives only in someone's memory.