Hi, I hope you're doing well. I’m looking for a developer to enhance and optimize an existing script that identifies brands offering “free gifts with purchase” on Amazon.in. I already have a working base script and documentation, which I will share for reference: The script is developed using Playwright and currently: Searches brands on Amazon.in Scans search result pages and product detail pages Detects gift offers using keywords Uses proxy rotation and basic anti-detection Exports results to Excel Includes logging for debugging This is not a from-scratch project — it’s an optimization and scaling task. My Current Setup Ryzen 7 5825U (8 cores / 16 threads) 16GB RAM Windows system The script will initially run on this machine, so optimization should be done within these limits. What I Need From You Performance Optimization Current approach is sequential (slow but stable) Need to implement parallel processing / multithreading, but optimized for my system (not overloading CPU/RAM) Category-Based Scraping We will maintain a manual list of ~40 category URLs inside the code This is intentional due to Amazon’s structure Should be easy to update in future Captcha / Blocking Handling For now, basic/manual handling is enough No need to integrate paid proxy or captcha services yet We will upgrade this later based on actual issues Scalability (Future-Ready) Code should be written in a way that can later run on a VPS/server for higher scaling Stability & Monitoring Proper logging Error handling Easy debugging when Amazon changes structure Code Quality Clean, modular, and maintainable code Easy for future updates and improvements Expected Output An Excel file containing: Brand Name Gift Available (Yes/No) Before We Proceed, Please Share: Your experience with Amazon scraping / anti-bot handling Your approach to safe parallel scraping (without getting blocked) Whether you recommend Playwright or Selenium for scaling Estimated timeline and cost Work Approach We will proceed using milestones for security. You can first improve the script and share initial results, and then we will continue further. Looking forward to working with you. Thanks!