Task parameters¶
Every CFG_TASK_PARAMETERS.PARAMETER_NAME etl-craft reads, by handler, generated from the handlers themselves. Each is explained in its handler's guide. A BUSINESS_RULES task reads none of its own: its rules are rows of CFG_BUSINESS_RULES. A name no handler reads is a validate warning.
Every task¶
Explained in its guide.
| Parameter | Applies to |
|---|---|
DOCUMENTATION |
|
RETRIES |
|
RETRY_BACKOFF |
|
RETRY_DELAY_SECONDS |
|
TASK_TIMEOUT_SECONDS |
SQL¶
Explained in its guide.
| Parameter | Applies to |
|---|---|
BASE_LOCATION |
where the table's files live |
CATALOG |
where the table's files live |
EXTERNAL_LOCATION |
where the table's files live |
EXTERNAL_VOLUME |
where the table's files live |
HARD_DELETE |
DELETE_ROWS |
MERGE_COMPARE_COLUMNS |
|
MERGE_DEDUPE_ORDER |
|
MERGE_KEY |
|
PIPELINE_ID_SUBSTITUTION |
|
PIPELINE_RUN_ID_FILTER |
|
PIPELINE_RUN_ID_SUBSTITUTION |
|
PRESERVE_TARGET |
SCD1_MERGE |
RUN_DATE_SUBSTITUTION |
|
SCHEMA_EVOLUTION |
OVERWRITE_TABLE, SCD1_MERGE, SCD2_MERGE |
SETUP_FOR |
|
SOURCE_SQL |
|
SOURCE_SQL_FILE |
|
SQL_ACTION |
|
TABLE_FORMAT |
|
TARGET_OBJECT |
|
TASK_RUN_ID_SUBSTITUTION |
PYTHON¶
Explained in its guide.
| Parameter | Applies to |
|---|---|
INPUT_PARAMS |
|
SCRIPT_NAME |
EMAIL_ALERT¶
Explained in its guide.
| Parameter | Applies to |
|---|---|
EMAIL_BODY |
|
EMAIL_BODY_COMPLETED_WITH_ERRORS |
one outcome: EMAIL_BODY_<OUTCOME> |
EMAIL_BODY_FAILED |
one outcome: EMAIL_BODY_<OUTCOME> |
EMAIL_BODY_SUCCESS |
one outcome: EMAIL_BODY_<OUTCOME> |
EMAIL_ON_STATUS |
|
EMAIL_PIPELINES |
|
EMAIL_SUBJECT |
|
EMAIL_SUBJECT_COMPLETED_WITH_ERRORS |
one outcome: EMAIL_SUBJECT_<OUTCOME> |
EMAIL_SUBJECT_FAILED |
one outcome: EMAIL_SUBJECT_<OUTCOME> |
EMAIL_SUBJECT_SUCCESS |
one outcome: EMAIL_SUBJECT_<OUTCOME> |
EMAIL_TO |