Field notes
How the platforms we run are built and kept running.
Written from the runbooks our estates are run from: the problem, what we do about it, and what we don't claim yet.
Delivery
A build webhook works only when a build starts
Our build webhooks answered with success and started nothing. Now each one is proved the only way that counts: fire it and watch a build start.
Read the note → DataEvery volume, every night: how our estates back up
Each volume that holds data is snapshotted at 02:00, encrypted and deduplicated, kept for about a year and partly read back every week.
Read the note → DeliveryKeeping builds moving on a slow line
Why our builds fetch apt, pip and npm packages through a pull-through cache, and what changed when the line to public registries was slow.
Read the note → IdentitySigning in with your own Active Directory
How Active Directory joins Authentik as an LDAP source: people and groups sync in, passwords stay with your directory, and groups decide roles.
Read the note →