Skip to main content

v2026.1Open SourceApache 2.0

Viglet Dumont DEP

Viglet Dumont DEP is an open-source data extraction platform. It connects your content — websites, databases, file systems, AEM, and WordPress — to Viglet Turing ES and other search engines through a reliable, asynchronous processing pipeline.

📄

Complete Documentation — v2026.1

All guides, connectors reference and configuration in a single portable PDF

⬇ Download PDF

Key Capabilities

🌐

Web Crawler

Recursively crawl websites with URL filtering, authentication, locale detection and incremental change detection.

🗄️

Database Connector

Run any SQL query against Oracle, PostgreSQL, MariaDB or MySQL and index each row as a searchable document.

📁

FileSystem Connector

Walk directory trees and extract text from PDFs, Word, Excel, PowerPoint and images (OCR) via Apache Tika.

📦

AEM Connector

Index AEM author and publish content with delta tracking, locale mapping and custom extension points.

📝

WordPress Connector

Pull posts, pages and custom content types from WordPress installations into any search engine.

🔌

Multi-Target Indexing

Deliver content to Turing ES (default), Apache Solr or Elasticsearch via pluggable indexing adapters.

Quick Start

Docker, standalone JAR or build from source

application.yaml, Turing ES connection and queue

Connectors, pipeline, strategies and job items

Choose a connector and start indexing content

Connectors

Recursive crawling with URL filtering, auth, user agents and locale detection

Database Connector

JDBC queries against Oracle, PostgreSQL, MariaDB, MySQL — CLI and integrated modes

FileSystem Connector

Directory traversal with Apache Tika text extraction, OCR and metadata mapping

Author/publish instances, delta tracking, locale mapping and custom extensions

WordPress Connector

Posts, pages and custom content types from WordPress installations

Architecture & Pipeline

Architecture Overview

Component diagram, data flow, module structure, tech stack and deployment topologies

Connectors, job items, processing strategies, change detection and indexing status

Indexing Plugins

Deliver content to Turing ES, Apache Solr or Elasticsearch via pluggable adapters

Technical Reference

Configuration Reference

Complete application.yaml property reference — server, database, queue, plugins

Developer Guide

Build from source, project structure, extension points and contribution guide