A Cron Job That Fired Twice: Notes From an Ingestion Pipeline
Last spring I inherited a small news-ingestion service: 14 worker processes on four nodes, pulling roughly 900 feeds, writing about 120k rows a day into Postgres 14, with a Redis 6 queue in front. The