Apache Airflow Installation on Ubuntu w/ Cloud Panel

1
16K

Main Resource:

https://s3.amazonaws.com/recipes.dezyre.com/use-emailoperator-airflow-dag/materials/Apache_Airflow_Installation_on_Ubuntu.pdf

https://docs.vultr.com/how-to-deploy-apache-airflow-on-ubuntu-20-04

 

First Issue:

Getting requirements to build wheel did not run successfully. apache-airflow mysql

Soltuion:

apt-get install pkg-config build-essential libmysqlclient-dev

Resource: https://stackoverflow.com/questions/76875507/can-not-install-apache-airflow-providers-mysql-pkg-config-error

 

At step 8 in the main resource unable to find the "airflow.cfg" file and so follow this to generate the cfg: https://airflow.apache.org/docs/apache-airflow/stable/howto/set-config.html#setting-configuration-options

 

Unable to find the folder, then lookup:

find / -name airflow -type d


Installting Supervisor:

To schedule the "scheduler" & "webserver"

Install: https://gcore.com/learning/how-to-set-up-supervisor-on-ubuntu/
Conf: https://gist.github.com/criccomini/1d50130d32db0a61905ec4e65b55c32d

Run both scheduler and webserver:

airflow scheduler &
airflow webserver &

https://stackoverflow.com/questions/73513328/how-to-run-airflow-scheduler-and-webserver-simultaneously

More Resources:

https://airflow.apache.org/docs/apache-airflow/stable/start.html

Search
Categories
Read More
Shopping
Redskins blast Bills to stay atop NFC East
The (7-7) remain in the driver's seat of the NFC East after knocking off the on Sunday in a game...
By Merl Treutel 2025-05-15 02:27:05 0 775
Shopping
third year in a row honoring Loewe the finest broadway productions
but wearing runway on the main stage is a huge step often not taken as serious as a lot of other...
By Remi Wells 2024-10-27 15:17:46 0 3K
Gardening
If Mike Evans is readily available, should Giants be fascinated?
Celebrity large receiver Mike Evans and the Tampa Bay Buccaneers could be gone to a parting of...
By Carthy7 Carthy7 2024-11-16 02:31:17 0 3K
Shopping
The Sporting News 7 podcast March Madness stunner for Auburn Steve Kerr cries foul after Warriors loss
Travis D'Arnaud Jersey Miami stuns Auburn to reach Sweet 16, Steve Kerr calls foul over Warriors...
By Merl Treutel 2025-05-15 02:59:04 0 797
Gardening
Golden Goose for the Signature Look fragrance
Golden Goose Outlet the upside is that the designers are able to spend more time doing the work...
By Amaris Rush 2025-05-30 04:51:58 0 987
Aldyra https://aldyra.com