I’m ready to push our existing Geodirectory scraper far beyond its current limits. Today the crawler works strictly off public websites, but I need it refined into a true “set-and-forget” data engine that feeds richer content, sharper media and smarter metadata directly into WordPress geodirectory. Core upgrade goals • Photo harvest: bump the limit from 10 to 20 per venue, always choosing the highest-resolution shot first and applying a simple “best-shot” ranking so only the crispest images make it through. • Video discovery: move from surface-level grabs to deep crawling that can locate embeds or links on YouTube, Vimeo and any on-site player the venue hosts—basically, if a video exists, the scraper must surface it. • Radius expansion: widen the geo search to 300 miles without sacrificing speed. • Duplicate & multi-category cleanup: smarter fingerprinting to merge dupes and correctly tag listings that belong in several categories. • Category selector UI: quick toggle inside the admin so I can target individual niches before import. • Amenities extractor: pull structured amenity data (wifi, parking, pet-friendly, etc.) into custom fields. • Review restructuring: normalise star ratings, body text and timestamps for better display and analytics. • Social expansion: detect and store all official socials—Facebook, Instagram, TikTok, X, LinkedIn. • API key tester: inline diagnostic that warns me if a required key or quota is missing before a run. • Import logic rewrite: optimise batch size, retry rules and error logging so large jobs never stall. • New preview screen: grouped-category view so I can spot gaps or bad matches before pressing “Import”. • Affiliate hooks: automatically link hotels, tours and events to Expedia, Viator and Eventbrite where matches exist, using my partner IDs. Ratings, reviews and amenities need to be scraped Deliverables & acceptance 1. Updated codebase (PHP + any helper scripts) checked into our private Git repo. 2. One-click installer/upgrade script for the WordPress plugin. 3. README covering config, new shortcode/field names and typical troubleshooting steps. 4. Proof-of-concept crawl on five major cities demonstrating 20 photos, at least one video, amenities and affiliate links per listing. If you’ve built sophisticated web scrapers, know WordPress internals and can blend AI text tools with clean PHP, let’s talk.