On-Demand Python Web Scraper UI and Data

Customer: AI | Published: 15.11.2025

Need a reusable Python script that I can trigger whenever new data is required for about 16 non english websites And some social media platforms like Fa ce B ook abd Insta gram The scraper must pull: Need the following info from non english websites •Product Information (e.g., pack size, price, brand, ingredients) •Category hierarchy (e.g., Beauty & Wellbeing, Personal Care, etc.) •Overall rating by customers and feedbacks •Promotional history (e.g., avg discounts) / Promo tags / promo campaigns •Brand information •Product launch date •Sales performance data •Competitor product listings Social Media like Facebook, •Feedback and comment history •User likes, share count, comments, hashtags •Influencer mentions and endorsements •Blog reviews •Trending keywords and search queries I routinely work with multiple storefronts and pages, so the code has to be modular: a separate, well-commented extractor for each domain plus a shared core for requests, parsing (BeautifulSoup / lxml or similar), and rate-limiting techniques that respect robots.txt while still getting the job done. CAPTCHA or anti-bot hurdles occasionally appear, so please include at least a basic bypass or fallback that keeps the run uninterrupted. Output format should default to CSV, but toggling to JSON or directly into my existing PostgreSQL table via SQLAlchemy would be ideal. Command-line arguments or a simple config file should let me add new target URLs, switch user-agents, and choose the output destination without touching the main code. Deliverables 1. Fully working Python 3.x script(s) with all dependencies clearly listed in requirements.txt. 2. Quick-start guide explaining setup, usage examples, and how to extend to new websites or Facebook pages. 3. Sample export proving that the scraper captures every required field from at least one e-commerce site and one Facebook page. Acceptance criteria: • Accurate capture of pack size, price, brand, ingredients, and corresponding social media comments for at least 50 live products. • No crashes when a site structure changes—graceful logging of missing fields instead. • Runtime under 10 minutes for those 50 products on a standard consumer connection. Code-only delivery is fine; I will handle deployment, so focus on clarity, reliability, and extensibility. However you may also provide the cost and time for both only codeing UI and UI with Data