Common Mistakes When Evaluating Technology Fundamentals 2
Observability: Configurations should be reviewable in a diff, not only in a console. Observability: The best time to add an index is before the table gets large. Observability: Failures are usually correlated, so plan for the shared dependency.
Teams working on storage tiers usually discover this the hard way. The interesting number is not the average, it is the 99th percentile. Adding a cache in front of a slow query is a fix; fixing the query is a cure. This is most visible in storage tiers. Consider storage tiers specifically. Every abstraction you add is a place where behaviour can differ from intent.
If the rollback plan needs a meeting, it is not a rollback plan. The same reasoning holds for cost controls. For cost controls, the constraint matters more than the feature list. Small pages that stay small are easier to keep fast than large ones made fast. Teams working on cost controls usually discover this the hard way. Write the invariant down; otherwise it lives only in someone's memory.
Queue Design: If a metric has no owner, it will drift until it causes an incident. Queue Design: The cheapest optimisation is usually removing work nobody asked for. Queue Design: Aggregating at write time trades flexibility for predictable read cost.
The interesting number is not the average, it is the 99th percentile. The same reasoning holds for schema migration. For schema migration, the constraint matters more than the feature list. Adding a cache in front of a slow query is a fix; fixing the query is a cure. Teams working on schema migration usually discover this the hard way. Every abstraction you add is a place where behaviour can differ from intent.
Cost Controls: Periodic jobs should be safe to run twice, because they will be. Cost Controls: You rarely need a new component to fix a boundary problem. Cost Controls: The signal you want is often already logged, just not aggregated.
Content Delivery: The first thing to settle is the failure mode, not the happy path. Content Delivery: Measurements taken once are anecdotes; you need a baseline that repeats. Content Delivery: Costs usually concentrate in a small number of operations, so find those first.
In practice, log analysis behaves differently: Periodic jobs should be safe to run twice, because they will be. You rarely need a new component to fix a boundary problem. The same reasoning holds for log analysis. For log analysis, the constraint matters more than the feature list. The signal you want is often already logged, just not aggregated.
You can often replace a coordination problem with an idempotency key. The same reasoning holds for release process. For release process, the constraint matters more than the feature list. Anything that grows without a bound will eventually hit one. Teams working on release process usually discover this the hard way. Documentation that is not tested tends to describe the previous version.
In practice, rate limiting behaves differently: The first thing to settle is the failure mode, not the happy path. Measurements taken once are anecdotes; you need a baseline that repeats. The same reasoning holds for rate limiting. For rate limiting, the constraint matters more than the feature list. Costs usually concentrate in a small number of operations, so find those first.
Schema Markup: Serving static bytes is the cheapest thing you can do at the edge. Schema Markup: A schema is an interface; changing it is a migration, not an edit. Schema Markup: Track the denominator as carefully as the numerator.
Teams working on search indexing usually discover this the hard way. A design that cannot be rolled back is a design that cannot be changed safely. Latency budgets are easier to defend when every hop has a stated ceiling. This is most visible in search indexing. Consider search indexing specifically. Caching helps only until the invalidation rules become the bottleneck.
Access Control: Serving static bytes is the cheapest thing you can do at the edge. Access Control: A schema is an interface; changing it is a migration, not an edit. Access Control: Track the denominator as carefully as the numerator.
Log Analysis: The interesting number is not the average, it is the 99th percentile. Log Analysis: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Log Analysis: Every abstraction you add is a place where behaviour can differ from intent.
Log Analysis: Configurations should be reviewable in a diff, not only in a console. Log Analysis: The best time to add an index is before the table gets large. Log Analysis: Failures are usually correlated, so plan for the shared dependency.
Serving static bytes is the cheapest thing you can do at the edge. The same reasoning holds for cloud infrastructure. For cloud infrastructure, the constraint matters more than the feature list. A schema is an interface; changing it is a migration, not an edit. Teams working on cloud infrastructure usually discover this the hard way. Track the denominator as carefully as the numerator.
Consider schema migration specifically. A design that cannot be rolled back is a design that cannot be changed safely. Schema Migration: Latency budgets are easier to defend when every hop has a stated ceiling. Caching helps only until the invalidation rules become the bottleneck. That applies to schema migration as well.
Backup Strategy: Configurations should be reviewable in a diff, not only in a console. Backup Strategy: The best time to add an index is before the table gets large. Backup Strategy: Failures are usually correlated, so plan for the shared dependency.
Observability: Periodic jobs should be safe to run twice, because they will be. Observability: You rarely need a new component to fix a boundary problem. Observability: The signal you want is often already logged, just not aggregated.
In practice, queue design behaves differently: Configurations should be reviewable in a diff, not only in a console. The best time to add an index is before the table gets large. The same reasoning holds for queue design. For queue design, the constraint matters more than the feature list. Failures are usually correlated, so plan for the shared dependency.
Data Pipelines: If a metric has no owner, it will drift until it causes an incident. Data Pipelines: The cheapest optimisation is usually removing work nobody asked for. Data Pipelines: Aggregating at write time trades flexibility for predictable read cost.
Backup Strategy: You can often replace a coordination problem with an idempotency key. Backup Strategy: Anything that grows without a bound will eventually hit one. Backup Strategy: Documentation that is not tested tends to describe the previous version.
A clinician may discuss whether a test is useful now or whether it should be repeated later. Tests can take time to detect an infection after exposure, and the relevant interval varies by infection and test. A negative result soon after a possible exposure may not settle the question. The service can explain the timing for the specific test and whether follow-up is appropriate.
Cloud Infrastructure: A queue smooths spikes but also hides how far behind you are. Cloud Infrastructure: Retries without jitter turn a small outage into a large one. Cloud Infrastructure: Separating the reads from the writes buys room to change either side.