Apache Airflow Installation on Ubuntu w/ Cloud Panel

1
18K

Main Resource:

https://s3.amazonaws.com/recipes.dezyre.com/use-emailoperator-airflow-dag/materials/Apache_Airflow_Installation_on_Ubuntu.pdf

https://docs.vultr.com/how-to-deploy-apache-airflow-on-ubuntu-20-04

 

First Issue:

Getting requirements to build wheel did not run successfully. apache-airflow mysql

Soltuion:

apt-get install pkg-config build-essential libmysqlclient-dev

Resource: https://stackoverflow.com/questions/76875507/can-not-install-apache-airflow-providers-mysql-pkg-config-error

 

At step 8 in the main resource unable to find the "airflow.cfg" file and so follow this to generate the cfg: https://airflow.apache.org/docs/apache-airflow/stable/howto/set-config.html#setting-configuration-options

 

Unable to find the folder, then lookup:

find / -name airflow -type d


Installting Supervisor:

To schedule the "scheduler" & "webserver"

Install: https://gcore.com/learning/how-to-set-up-supervisor-on-ubuntu/
Conf: https://gist.github.com/criccomini/1d50130d32db0a61905ec4e65b55c32d

Run both scheduler and webserver:

airflow scheduler &
airflow webserver &

https://stackoverflow.com/questions/73513328/how-to-run-airflow-scheduler-and-webserver-simultaneously

More Resources:

https://airflow.apache.org/docs/apache-airflow/stable/start.html

Search
Categories
Read More
Shopping
Bill Cowher Rex has made mockery of captain tag
Rex Ryan's decision to name special teamer a captain Thursday night Richard Dent Jersey against...
By Merl Treutel 2025-05-15 02:43:14 0 3K
Other
Rising Demand Assessment Highlights Future Prospects for the Hydrogen Sulphide Market
The Hydrogen Sulphide Market has witnessed notable growth over the past decade, supported by...
By Shubham Gurav 2025-11-04 09:04:56 0 1K
Games
Outer Banks Final Season – Production Begins in Charleston
Outer Banks Final Season Production Cameras are now rolling on the ultimate chapter of Netflix's...
By Xtameem Xtameem 2025-11-26 02:54:25 0 752
Other
Vaccine Cold Chain Logistics Ensuring Safe and Reliable Immunization Distribution Worldwide
The importance of vaccine cold chain logistics cannot be overstated, particularly in the context...
By Mayuri Kathade 2025-09-15 11:56:30 0 2K
Other
Forecasts for the AI in VFX Market
  The AI in VFX Market forecasts indicate a significant upward trajectory over the coming...
By Sssd Ddssa 2025-09-24 07:34:08 0 1K
Aldyra https://aldyra.com