I need an experienced developer to build a reliable and scalable web scraping automation tool that can extract structured data from multiple websites on a recurring basis. This isn’t a simple “one-page scrape”—I need a robust solution with proper error handling, data validation, and anti-bot mitigation to ensure consistent performance. What needs to be handled: • Identify the best scraping strategy (requests + parsing, headless browser, rotating proxies, etc.). • Build a scraper that extracts product details, pricing, images, and metadata from several targeted websites. • Normalize and clean the extracted data into a consistent JSON or CSV format. • Implement automatic retries, user-agent rotation, and IP rotation if necessary. • Store the scraped data in a database (MySQL, MongoDB, or PostgreSQL—open to your recommendation). • Create a simple dashboard or endpoint to trigger manual runs and view logs/status. • Provide documentation, including setup instructions and code explanation. Resources you will have: • Target URLs and specific data fields required. • API keys for any scraping infrastructure (proxies, Captcha solving, etc.) if needed. • Access to my hosting environment or server to deploy the scraper. • Freedom to use Python, Node.js, or another suitable language. Expected result: – Automated scraper that runs on a schedule (Cron or cloud-based). – Clean, validated JSON/CSV datasets with uniform structure. – A small admin panel or logs page showing run history and errors. – Clear documentation and next-step recommendations.