Apache Airflow Installation on Ubuntu w/ Cloud Panel

1
15K

Main Resource:

https://s3.amazonaws.com/recipes.dezyre.com/use-emailoperator-airflow-dag/materials/Apache_Airflow_Installation_on_Ubuntu.pdf

https://docs.vultr.com/how-to-deploy-apache-airflow-on-ubuntu-20-04

 

First Issue:

Getting requirements to build wheel did not run successfully. apache-airflow mysql

Soltuion:

apt-get install pkg-config build-essential libmysqlclient-dev

Resource: https://stackoverflow.com/questions/76875507/can-not-install-apache-airflow-providers-mysql-pkg-config-error

 

At step 8 in the main resource unable to find the "airflow.cfg" file and so follow this to generate the cfg: https://airflow.apache.org/docs/apache-airflow/stable/howto/set-config.html#setting-configuration-options

 

Unable to find the folder, then lookup:

find / -name airflow -type d


Installting Supervisor:

To schedule the "scheduler" & "webserver"

Install: https://gcore.com/learning/how-to-set-up-supervisor-on-ubuntu/
Conf: https://gist.github.com/criccomini/1d50130d32db0a61905ec4e65b55c32d

Run both scheduler and webserver:

airflow scheduler &
airflow webserver &

https://stackoverflow.com/questions/73513328/how-to-run-airflow-scheduler-and-webserver-simultaneously

More Resources:

https://airflow.apache.org/docs/apache-airflow/stable/start.html

Search
Categories
Read More
Other
collection was characterized by Saint Laurent Handbags exacting tailoring
In culture he explains women run the show. Around years ago the hat seemed to be Saint Laurent...
By Remi Wells 2024-10-18 08:04:22 0 3K
Home
d-sub waterproof ip67 connectors wholesale The perfect combination for low power applications
With the continuous development of low-power applications, d-sub waterproof ip67 connectors...
By Aldyracom Aldyracom 2024-05-21 06:33:27 0 7K
Shopping
Greubel Forsey Tourbillon
Greubel Forsey Tourbillon Cardan: - High Precision Horological Recreation space, Double...
By Yexra Yexra 2024-08-28 10:29:39 0 4K
Networking
Secrets of legendary player Messi
Secrets of legendary player MessiLionel Messi's career is marked by incredible skill, precision,...
By Phoco Phocohanoi2 2025-02-20 07:26:32 0 820
Shopping
rather hibernate Tdsshoes than deal with frigid temps and sunsets
Over 1.5 million trees have been planted so far, a third of which have gone to the rainforest....
By Priscilla Gamble 2024-11-28 14:06:49 0 1K