Skip to content
DealAI.lt Documentation

Elasticsearch Overview

Overview

Section titled “Overview”

This documentation covers a complete Elasticsearch integration for a WordPress-based product catalog system. The integration provides advanced Lithuanian language search capabilities for 60,000+ products with real-time synchronization, comprehensive monitoring, and automated management.

Key Features

Section titled “Key Features”

🔍 Advanced Search Capabilities

Section titled “🔍 Advanced Search Capabilities”
  • Lithuanian Language Support: Custom analyzer with snowball stemming
  • Full-Text Search: Multi-field search across title, brand, description
  • Fuzzy Matching: Typo-tolerant search with configurable fuzziness
  • Advanced Filtering: Category, brand, price range, availability filters

⚡ Performance & Scalability

Section titled “⚡ Performance & Scalability”
  • 60,000+ Products: Optimized for large datasets
  • Real-time Sync: Automated synchronization with PostgreSQL
  • Batch Processing: Efficient bulk indexing operations
  • Sub-second Response: Fast search query performance

🛠️ Management & Monitoring

Section titled “🛠️ Management & Monitoring”
  • Real-time Console: Comprehensive monitoring dashboard
  • Progress Tracking: ETA calculations and sync status
  • Error Recovery: Automatic failed batch handling
  • Log Management: Detailed logging and troubleshooting

🔧 Integration Features

Section titled “🔧 Integration Features”
  • WordPress Native: Seamless WordPress integration
  • AJAX Endpoints: Dynamic frontend interactions
  • Admin Dashboard: User-friendly management interface
  • Cron Automation: Scheduled synchronization tasks

Architecture Overview

Section titled “Architecture Overview”

The Elasticsearch integration follows a clean separation of concerns with three main layers:

┌─────────────────────────────────────────────────────────────┐
│                    User Interface Layer                     │
├─────────────────────┬─────────────────────┬─────────────────┤
│   Search Page       │  Monitoring Console │   Admin Panel   │
│ (page-search.php)   │ (console.php)       │ (WordPress)     │
└─────────────────────┴─────────────────────┴─────────────────┘
┌─────────────────────────────────────────────────────────────┐
│                   WordPress Integration                     │
├─────────────────────┬─────────────────────┬─────────────────┤
│  AJAX Handlers      │  Template System    │  Hook System    │
│ (functions.php)     │ (page templates)    │ (WordPress)     │
└─────────────────────┴─────────────────────┴─────────────────┘
┌─────────────────────────────────────────────────────────────┐
│                   Business Logic Layer                     │
├─────────────────────┬─────────────────────┬─────────────────┤
│  Elasticsearch      │  Console Manager    │  Sync Manager   │
│  Client             │ (Display Only)      │ (CLI/Cron)     │
└─────────────────────┴─────────────────────┴─────────────────┘
┌─────────────────────────────────────────────────────────────┐
│                     Data Storage Layer                     │
├─────────────────────┬─────────────────────────────────────────┤
│   PostgreSQL        │           Elasticsearch               │
│   (Source Data)     │         (Search Index)                │
└─────────────────────┴─────────────────────────────────────────┘

Key Design Principles

Section titled “Key Design Principles”

1. Clean Separation

Section titled “1. Clean Separation”
  • CLI/cron operations separate from WordPress display operations
  • Business logic isolated from presentation layer
  • Database operations abstracted from search operations

2. Fail-Safe Architecture

Section titled “2. Fail-Safe Architecture”
  • Robust error handling and automatic recovery mechanisms
  • Failed batch tracking and automatic skipping
  • Connection timeout and retry handling

3. Performance Optimization

Section titled “3. Performance Optimization”
  • Optimized for large datasets (60k+ products)
  • Batch processing with configurable sizes
  • Memory management and garbage collection

4. Comprehensive Monitoring

Section titled “4. Comprehensive Monitoring”
  • Real-time progress tracking
  • Performance metrics and ETA calculations
  • Detailed logging and error reporting

5. Language Support

Section titled “5. Language Support”
  • Native Lithuanian language analysis and search
  • Custom analyzers with snowball stemming
  • Multi-language text processing capabilities

System Requirements

Section titled “System Requirements”

Server Requirements

Section titled “Server Requirements”
  • PHP: 8.0+ with PostgreSQL and cURL extensions
  • PostgreSQL: 13+ with read/write access
  • Elasticsearch: 7.x running and accessible
  • WordPress: 6.x with custom theme support

Network Requirements

Section titled “Network Requirements”
  • Elasticsearch Server: 91.99.113.45:9200
  • Database Server: 162.55.174.116:5432
  • Web Server: HTTP/HTTPS access for WordPress

Storage Requirements

Section titled “Storage Requirements”
  • Index Storage: ~2GB for 60k products
  • Log Storage: ~100MB for operation logs
  • State Files: ~1MB for sync state persistence

Quick Start

Section titled “Quick Start”

1. Basic Setup

Section titled “1. Basic Setup”
Terminal window
# Deploy core files
cp inc/elasticsearch*.php /wp-content/themes/products/inc/
cp scripts/elasticsearch-auto-sync.php /wp-content/themes/products/scripts/

2. Database Configuration

Section titled “2. Database Configuration”
ALTER TABLE product ADD COLUMN added_search BOOLEAN DEFAULT FALSE;
CREATE INDEX idx_product_added_search ON product(added_search);

3. Cron Setup

Section titled “3. Cron Setup”
Terminal window
# Add to crontab
*/15 * * * * /usr/bin/php /path/to/elasticsearch-auto-sync.php

4. WordPress Pages

Section titled “4. WordPress Pages”
  • Create page with “Search Page” template
  • Create page with “Elasticsearch Console” template

What’s Next

Section titled “What’s Next”