Automation Scripts (/scripts/)

Scripts Directory

The /scripts/ directory contains automation and maintenance scripts.

Key Scripts

elasticsearch-auto-sync.php (611+ lines)

Main Elasticsearch synchronization engine.

product-crawler-manager.php (277+ lines)

Manages product scan batches for Scrapyd.

product-screenshot-manager.php

Automated screenshot capture.

crawler-manager.php

Category-based crawler management.

Utilities

• check-db.php - Database verification
• verify-setup.php - System validation
• test-crawler.php - Testing utilities

/cron/ Subdirectory

• migrate-core-categories.php
• update-core-categories.php

Next Steps

• Automation - Cron job setup
• Data Pipeline - Processing flow