DuckDB
Embedded analytics engine: local files or MotherDuck (cloud)
Access mode: Read-only
Trino connector. Queryable via Flume’s Lakehouse. This system can be accessed both through its native protocol (for metadata introspection) and via Trino federation (for data profiling and cross-system analytical queries).
Required information
| Field | Details |
|---|---|
| Access method | Local file path to .duckdb file, or MotherDuck connection string. |
| MotherDuck token | If using MotherDuck (cloud): service token from MotherDuck console. |
| Database file location | Local: filesystem path. Remote: S3/GCS/ADLS path if DuckDB files are stored on object storage. |
Network considerations
DuckDB is embedded: It runs in-process, not as a server. No TCP port to connect to.
Local files: DuckDB database files must be accessible from Flume’s filesystem (mounted volume, object storage, or copied locally).
MotherDuck: HTTPS to app.motherduck.com. SaaS, so no VPN is needed.
Object storage: If .duckdb files or Parquet files queried by DuckDB live on S3/GCS/ADLS, cloud storage credentials are needed (see S3/GCS/Azure Blob connector).
Trino access: Flume’s Lakehouse queries DuckDB via the Trino DuckDB connector.
Credential and auth management
Local DuckDB: No authentication. Access is filesystem-level. Whoever can read the file can query it.
MotherDuck: Service token (API token) from MotherDuck dashboard. Scoped to organization.
Object storage credentials: If DuckDB reads from S3/GCS, those credentials must be available (IAM role, service account, etc.).
Validation checks
| Check | Method | Expected result |
|---|---|---|
| File access | Open the .duckdb file or connect to MotherDuck | Connection established |
| Table listing | SHOW TABLES | Lists tables |
| Read test | SELECT * FROM <table> LIMIT 1 | Returns a row |
| MotherDuck auth | Connect with token, run SELECT current_database() | Returns database name |
Every connection starts from the pre-engagement checklist and goes through the universal validation protocol before production sign-off.