Main Resource:

https://s3.amazonaws.com/recipes.dezyre.com/use-emailoperator-airflow-dag/materials/Apache_Airflow_Installation_on_Ubuntu.pdf

https://docs.vultr.com/how-to-deploy-apache-airflow-on-ubuntu-20-04

First Issue:

Getting requirements to build wheel did not run successfully. apache-airflow mysql

Soltuion:

apt-get install pkg-config build-essential libmysqlclient-dev

Resource: https://stackoverflow.com/questions/76875507/can-not-install-apache-airflow-providers-mysql-pkg-config-error

At step 8 in the main resource unable to find the "airflow.cfg" file and so follow this to generate the cfg: https://airflow.apache.org/docs/apache-airflow/stable/howto/set-config.html#setting-configuration-options

Unable to find the folder, then lookup:

find / -name airflow -type d


Installting Supervisor:

To schedule the "scheduler" & "webserver"

Install: https://gcore.com/learning/how-to-set-up-supervisor-on-ubuntu/
Conf: https://gist.github.com/criccomini/1d50130d32db0a61905ec4e65b55c32d

Run both scheduler and webserver:

airflow scheduler &
airflow webserver &

https://stackoverflow.com/questions/73513328/how-to-run-airflow-scheduler-and-webserver-simultaneously

More Resources:

https://airflow.apache.org/docs/apache-airflow/stable/start.html