Presently, we have backend processes ingesting data feeds, transforming and loading them into BigQuery via Google Cloud Compose (Airflow). Checks are done daily to ensure data were loaded into their respective endpoints. Evidently, some jobs will fail for whatever reasons.
It will be ideal if JIRA can listen to the outcome of a job runs and raise an issue automatically if a job did not complete successfully. Is this possible?
If not, what options do we have?