Real-estate data pipeline

Designed a resilient Node.js scraping engine with a fault-tolerant, resumable pipeline and serverless cron (EventBridge + Lambda).

Company names and identifying details are withheld for confidentiality.

• 01

  Architected a Node.js web-scraping engine that reliably collected real-estate listing data across frequently changing third-party site structures, including dynamic click-through navigation into deeper pages.

• 02

  Proposed and built a fault-tolerant pipeline that listed already-processed URLs so it could resume from where it left off after interruptions.

• 03

  Automated daily batch jobs with GitHub Actions and integrated Slack notifications for success / failure results.