Planned and led · Zyte
500 TB of customer data, moved without anyone noticing
The platform's entire scraped-data store lived on an ageing Hadoop/HBase cluster — every customer's data, on hardware that had to go. I planned the migration, coordinated it across teams, ran it through to full production cutover and decommissioned the legacy hardware afterwards. Years later, when a stack upgrade on the successor cluster introduced a serious memory leak, I led the investigation across several squads, found the root cause and got the fix in — keeping the platform on a supported stack instead of frozen on an unsupported one.
- Hadoop / HBase
- Zero-downtime migration
- Root-cause analysis
- Cross-team lead