Www Independent coverage of news

Technology Fundamentals 2 Benchmarks and What They Hide

By James Whitfield · · 1150 words
Technology Fundamentals 2 Benchmarks and What They Hide

Cost Controls: The first thing to settle is the failure mode, not the happy path. Cost Controls: Measurements taken once are anecdotes; you need a baseline that repeats. Cost Controls: Costs usually concentrate in a small number of operations, so find those first.

The first thing to settle is the failure mode, not the happy path. This is most visible in schema markup. Consider schema markup specifically. Measurements taken once are anecdotes; you need a baseline that repeats. Schema Markup: Costs usually concentrate in a small number of operations, so find those first.

The first thing to settle is the failure mode, not the happy path. This is most visible in data pipelines. Consider data pipelines specifically. Measurements taken once are anecdotes; you need a baseline that repeats. Data Pipelines: Costs usually concentrate in a small number of operations, so find those first.

Schema Migration: If the rollback plan needs a meeting, it is not a rollback plan. Schema Migration: Small pages that stay small are easier to keep fast than large ones made fast. Schema Migration: Write the invariant down; otherwise it lives only in someone's memory.

If the rollback plan needs a meeting, it is not a rollback plan. The same reasoning holds for data pipelines. For data pipelines, the constraint matters more than the feature list. Small pages that stay small are easier to keep fast than large ones made fast. Teams working on data pipelines usually discover this the hard way. Write the invariant down; otherwise it lives only in someone's memory.

API Design: If the rollback plan needs a meeting, it is not a rollback plan. API Design: Small pages that stay small are easier to keep fast than large ones made fast. API Design: Write the invariant down; otherwise it lives only in someone's memory.

Search Indexing: If a metric has no owner, it will drift until it causes an incident. Search Indexing: The cheapest optimisation is usually removing work nobody asked for. Search Indexing: Aggregating at write time trades flexibility for predictable read cost.

Data Pipelines: The interesting number is not the average, it is the 99th percentile. Data Pipelines: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Data Pipelines: Every abstraction you add is a place where behaviour can differ from intent.

Data Pipelines: Serving static bytes is the cheapest thing you can do at the edge. Data Pipelines: A schema is an interface; changing it is a migration, not an edit. Data Pipelines: Track the denominator as carefully as the numerator.

Search Indexing: Periodic jobs should be safe to run twice, because they will be. Search Indexing: You rarely need a new component to fix a boundary problem. Search Indexing: The signal you want is often already logged, just not aggregated.

Load Balancing: Configurations should be reviewable in a diff, not only in a console. Load Balancing: The best time to add an index is before the table gets large. Load Balancing: Failures are usually correlated, so plan for the shared dependency.

Load Balancing: A design that cannot be rolled back is a design that cannot be changed safely. Load Balancing: Latency budgets are easier to defend when every hop has a stated ceiling. Load Balancing: Caching helps only until the invalidation rules become the bottleneck.

API Design: Periodic jobs should be safe to run twice, because they will be. API Design: You rarely need a new component to fix a boundary problem. API Design: The signal you want is often already logged, just not aggregated.

Storage Tiers: You can often replace a coordination problem with an idempotency key. Storage Tiers: Anything that grows without a bound will eventually hit one. Storage Tiers: Documentation that is not tested tends to describe the previous version.

Cloud Infrastructure: Configurations should be reviewable in a diff, not only in a console. Cloud Infrastructure: The best time to add an index is before the table gets large. Cloud Infrastructure: Failures are usually correlated, so plan for the shared dependency.

HIV and syphilis screening usually involves a blood sample, although the exact test and collection method can vary. Some services offer rapid tests, while others send samples to a laboratory. Hepatitis B or C testing may be offered based on factors such as pregnancy, vaccination history, previous results or particular exposure risks; it is not automatically part of every sexual-health check.

For schema migration, the constraint matters more than the feature list. Periodic jobs should be safe to run twice, because they will be. Teams working on schema migration usually discover this the hard way. You rarely need a new component to fix a boundary problem. The signal you want is often already logged, just not aggregated. This is most visible in schema migration.

If the rollback plan needs a meeting, it is not a rollback plan. That applies to access control as well. In practice, access control behaves differently: Small pages that stay small are easier to keep fast than large ones made fast. Write the invariant down; otherwise it lives only in someone's memory. The same reasoning holds for access control.

In practice, storage tiers behaves differently: A queue smooths spikes but also hides how far behind you are. Retries without jitter turn a small outage into a large one. The same reasoning holds for storage tiers. For storage tiers, the constraint matters more than the feature list. Separating the reads from the writes buys room to change either side.

Consider observability specifically. The interesting number is not the average, it is the 99th percentile. Observability: Adding a cache in front of a slow query is a fix; fixing the query is a cure. Every abstraction you add is a place where behaviour can differ from intent. That applies to observability as well.

Edge Caching: Periodic jobs should be safe to run twice, because they will be. Edge Caching: You rarely need a new component to fix a boundary problem. Edge Caching: The signal you want is often already logged, just not aggregated.

A queue smooths spikes but also hides how far behind you are. This is most visible in rate limiting. Consider rate limiting specifically. Retries without jitter turn a small outage into a large one. Rate Limiting: Separating the reads from the writes buys room to change either side.

Access Control: A design that cannot be rolled back is a design that cannot be changed safely. Access Control: Latency budgets are easier to defend when every hop has a stated ceiling. Access Control: Caching helps only until the invalidation rules become the bottleneck.

You can often replace a coordination problem with an idempotency key. That applies to observability as well. In practice, observability behaves differently: Anything that grows without a bound will eventually hit one. Documentation that is not tested tends to describe the previous version. The same reasoning holds for observability.

Related reading