Install Apache Airflow on Ubuntu 22.04

1
9χλμ.

Step 1: Install CloudPanel Via Ansible (Optional)

$ apt update && apt -y upgrade && apt -y install curl wget git ansible

$ git clone https://github.com/saimintech/Ansible_Playbooks.git /home/Ansible_Playbooks/ && cd /home/Ansible_Playbooks/
$ ansible-playbook -i hosts.ini cloudpanel_install.yaml

Step 2: Install Apache Airflow

  1. Install the Python package manager, and virtual environment.

     $ sudo apt-get install -y python3-pip python3-venv
  2. Create a new project directory.

     $ mkdir airflow-project
  3. Change to the directory.

     $ cd airflow-project
  4. Create a new virtual environment.

     $ python3 -m venv airflow-env
  5. Activate the virtual environment.

     $ source airflow-env/bin/activate

    Your terminal prompt should change as below:

     (airflow-env) user@example:~/airflow-project$ 
  6. Using pip, install Airflow.

     $ pip install apache-airflow
  7. Initialize a new SQLite database to create the Airflow meta-store that Airflow needs to run.

     $ airflow db init
  8. Create the administrative user and password used to access Airflow.

     $ airflow users create --role Admin --username admin --email admin --firstname admin --lastname admin --password my-password

 

Step 3: Install Node.js 18 from package

  1. Obtain the Node.js source:

    curl -sL https://deb.nodesource.com/setup_18.x | sudo bash -
  2. Install the 16.x version of Node.js:

    sudo apt-get install -y nodejs
  3. Verify that the correct version of Node.js is installed:

    node -v
  4. Ensure that the most current version of NPM is installed:

    sudo npm install -g npm@latest
  5. Check the NPM version:


    npm -v

Step 4: Install PM2 

  1. Install PM2:

    npm install pm2@latest -g
  2. Start Airflow Scheduler & Webserver

    pm2 start --name "airflow-scheduler" /bin/bash -- -c "source /root/airflow-project/airflow-env/bin/activate && airflow scheduler"

    pm2 start --name "airflow-webserver" /bin/bash -- -c "source /root/airflow-project/airflow-env/bin/activate && airflow webserver -p 8080"
  3. Save PM2 Process List and Set Up Startup

    pm2 save

    pm2 startup
  4. Check PM2 Logs for Errors
pm2 logs airflow-scheduler

pm2 logs airflow-webserver

 

Like
1
Αναζήτηση
Κατηγορίες
Διαβάζω περισσότερα
άλλο
Understanding Market Share in the Expanding Data Center Network Infrastructure Market
  The Data Center Network Infrastructure Market plays a crucial role in enabling...
από Sssd Ddssa 2025-11-14 07:43:18 0 682
Shopping
How Can Tyvek Flat Roll Pouch Fit Hopeway AMD Users' Routines?
In many industries, people often look for packaging materials that balance steadiness, usability,...
από hua fufu 2025-12-04 01:26:43 0 578
άλλο
Plant Based Leather Market Size, Insights, Growth Rate, Trends Analysis and Forecast to 2030
As per MarkNtel Advisors the Global Plant-Based Leather Market size was valued at...
από John Ryan 2025-11-06 10:18:57 0 1χλμ.
Religion
75 Years and Counting: The Tale of the 1985 Cleveland Indians
The 1985 Cleveland Indians must not have lost 102 video games. Pythagoras suggests that with...
από Chad Fortners 2024-07-31 03:14:29 0 7χλμ.
Shopping
the night also included a new award for design presented by a digital
Admittedly they don't hold a candle to the real thing but for millions of users these virtual...
από Priscilla Gamble 2024-12-24 14:44:28 0 3χλμ.
Aldyra https://aldyra.com