DealAI.lt Platform Documentation

Platform Overview

DealAI.lt is a sophisticated e-commerce intelligence platform that aggregates and processes product data from multiple Lithuanian online retailers. Built on enterprise-grade technology, it provides advanced search capabilities, real-time price tracking, and comprehensive product analytics.

60,000+ Products

Comprehensive product catalog aggregated from multiple Lithuanian e-commerce sites with real-time updates.

Advanced Search

Elasticsearch-powered search with Lithuanian language support, fuzzy matching, and intelligent filtering.

Price Tracking

Historical price analysis with trend visualization, discount detection, and availability monitoring.

Automated Scraping

Distributed web crawling infrastructure using Scrapyd with automated job scheduling and monitoring.

Real-time Dashboards

Comprehensive administrative interfaces for monitoring, analytics, and system management.

Enterprise Ready

Built with PostgreSQL, Elasticsearch, and WordPress - scalable, secure, and production-tested.

Key Capabilities

Intelligent Product Discovery

Multi-field search across titles, brands, descriptions, and categories with Lithuanian language analysis, typo tolerance, and relevance scoring.

Price Intelligence

Track price changes over time, identify trends, detect discounts, and monitor product availability across multiple retailers.

Automated Data Collection

Distributed web scraping system that automatically collects product data, images, and pricing information from partner sites.

Visual Documentation

Automated screenshot capture of product pages for visual change tracking and quality assurance.

Comprehensive Analytics

Real-time dashboards showing system performance, data quality metrics, and business intelligence.

Technology Stack

Backend

WordPress 6.x with custom theme PHP 8.x for business logic PostgreSQL 13+ for data storage

Search & Analytics

Elasticsearch 7.x with Lithuanian analyzer Advanced filtering and aggregations Real-time indexing pipeline

Data Collection

Scrapyd distributed crawling Python-based scrapers Queue management system

Frontend

Tailwind CSS + Flowbite UI Chart.js for visualizations jQuery for interactivity

Quick Navigation

For Developers

• Installation Guide - Set up your development environment
• Architecture Overview - Understand the system design
• API Reference - Integrate with DealAI.lt APIs
• File Structure - Navigate the codebase

For Administrators

• Scrapyd Control - Manage web scraping jobs
• Elasticsearch Console - Monitor search synchronization
• Product Management - Administer the product catalog
• Troubleshooting - Resolve common issues

Core Features

• Product Search - Advanced search implementation
• Price History - Price tracking system
• Category Management - Hierarchical categorization
• Analytics - Reporting and insights

System Highlights

📊 Scale

• 60,000+ active products
• Multiple e-commerce sources
• Real-time data synchronization
• Sub-second search response times

🔍 Search Quality

• Lithuanian language analysis
• Fuzzy matching for typos
• Multi-field search
• Intelligent relevance scoring

⚡ Performance

• Batch processing for efficiency
• Connection pooling for databases
• Strategic indexing for fast queries
• CDN-ready architecture

🔒 Security

• WordPress authentication
• Parameterized queries (SQL injection prevention)
• Input sanitization throughout
• Admin-only console access

Getting Started

Ready to dive in? Start with our Introduction to understand the platform fundamentals, then follow the Quick Start Guide to get your environment set up.

For specific features or systems, use the sidebar navigation to jump directly to the relevant documentation section.

---

Need Help? Check out our Troubleshooting Guide or explore the API Documentation for integration details.