Deploying

Running etl-craft on a machine or under an orchestrator.

• The project directory: etl-craft/, with the config, SQL files, ingestion scripts, migrations and logs, and how commands find it.
• Local mode: etl-craft as the orchestrator, runs started on a schedule, and stepping in.
• Running under an orchestrator: generate-yml, the DAG it writes, and the global DAG.
• Checking a deployment: doctor and setup: every check, and setting up or upgrading in one command.
• Cloning into the warehouse: copying the Engine DB tables into the warehouse after every run, and etl-craft clone.
• Engine DB setup and upgrades: init-db, migrate, and your own migrations.
• Operations: backups, upgrades, logs and watching runs.

• Security: secrets, least-privilege accounts, and what tasks can do.

• Local server: leadership, submitting active runs, crash recovery and graceful shutdown.