This project implements a pipeline to clean the history of XCOM variables stored by Airflow.
The information contained herein is confidential and proprietary to the research group.
Use, copying, transfer, or disclosure of this information without the owner's consent is prohibited.
ALL RIGHTS RESERVED (c) 2023 LEMA-UFPB. João Pessoa, PB, Brazil
Tools:
- Never save sensitive credential data in GitLab (even if encrypted).
- Review code and apply linting before pushing.
- Use the task or feature code in the commit message. Ex:
git commit -m "task/01: message ...". - Open a merge request to the
mainbranch and request a reviewer.
- Agile Development
In VSCode, execute tests in Airflow via command line using the F5 key. Tasks have been configured in the .vscode directory for pre-checking the Docker environment for local execution of the data pipeline.
- Access the Airflow Webserver at http://localhost:8080