Ciaren

Credentials stay explicit and local

Connect the data you already have

Databases, warehouses, object storage, files, and APIs. Each driver is an optional pip extra, so the core install stays lean and you add only what you use.

Install only the drivers you need

  • PostgreSQL

    python -m pip install "ciaren[postgres]"

  • Amazon S3

    python -m pip install "ciaren[s3]"

  • Every database driver at once

    python -m pip install "ciaren[all]"

Available today

In the open-source core

Every entry below ships in the core repo. Entries marked Extra need their pip extra; the rest work with the base install.

SQL databases

Setup docs

PostgreSQL

Extra

Query results in, tables out, with custom SQL support.

pip install "ciaren[postgres]"

MySQL / MariaDB

Extra

Read and write over the standard wire protocol.

pip install "ciaren[mysql]"

SQLite

Built in

Zero-setup local databases. Works out of the box.

Included in the base install

DuckDB

Extra

In-process analytics database for fast local OLAP.

pip install "ciaren[duckdb]"

SQL Server

Extra

Microsoft SQL Server via ODBC.

pip install "ciaren[mssql]"

Snowflake

Extra

Read from and write to Snowflake warehouses.

pip install "ciaren[snowflake]"

Object & document storage

Setup docs

Amazon S3

Extra

Buckets, custom regions, and S3-compatible endpoints (MinIO, R2…).

pip install "ciaren[s3]"

Azure Blob Storage

Extra

Including custom endpoints for sovereign clouds.

pip install "ciaren[azure]"

Google Cloud Storage

Extra

Read and write GCS buckets.

pip install "ciaren[gcs]"

MongoDB

Extra

Collections in and out of your flows.

pip install "ciaren[mongo]"

Local folders

Built in

Your filesystem is a first-class source. No setup.

Included in the base install

File formats

Setup docs

CSV / TSV

Built in

Streaming reads on the Polars engine.

Included in the base install

Parquet

Built in

Columnar files, read and written natively.

Included in the base install

Excel (.xlsx)

Built in

Spreadsheets in, spreadsheets out.

Included in the base install

JSON / JSONL

Built in

Nested and line-delimited data.

Included in the base install

Text

Built in

Plain-text files for simple pipelines.

Included in the base install

APIs & automation

Setup docs

REST APIs

Built in

Read-only HTTP connector with auth, pagination, and SSRF protection.

Included in the base install

Webhooks

Built in

Trigger any flow from external systems over HTTP.

Included in the base install

REST API & CLI

Built in

Everything the UI does is a documented FastAPI endpoint; scripting via the ciaren CLI and Python client.

Included in the base install

Cron scheduling

Built in

Built-in timezone-aware scheduler with retries and catch-up.

Included in the base install

Machine learning

Setup docs

MLflow

Built in

Every training run tracked in a local store, a remote server, or Databricks.

Included in the base install

scikit-learn

Built in

Classifiers, regressors, clustering, and PCA built in.

Included in the base install

XGBoost & LightGBM

Extra

Gradient-boosted models as optional extras.

pip install "ciaren[ml]"

Once a source is connected, you can build a visual ETL pipeline on top of it and automate it with schedules and webhooks.

Roadmap

Planned integrations

From the public roadmap. These are directions under exploration, not dated commitments. Most new integrations will arrive as plugins.

Planned

Connector plugins

More databases, SaaS APIs, and storage backends delivered as marketplace plugins rather than core bloat.

Planned

Notebook export

Export flows as Jupyter notebooks alongside the existing pandas and Polars scripts.

Planned

Validation exports

Turn data-quality checks into external test and validation formats.

Planned

Job-template export

Reusable job templates for handing pipelines to orchestrators like Airflow.

Planned

AI providers

Assistive workflows through opt-in AI provider plugins, never a required dependency.

Planned

Richer automation triggers

Deeper REST, CLI, and webhook-based ways to run flows outside the UI.

Missing a connector you need?

You can build it today with the plugin SDK, or open a discussion and make the case.

Explore the plugin SDKRequest an integration

Connect your first database

Install Ciaren locally and point it at a database, a bucket, or a folder of files.

Get started on GitHubRead the Docs