/
NiFi

NiFi

Owned by Víctor Enrique Mendoza Yanes
Last updated: Oct 07, 2024
1 min read

On this page:

Apache NiFi is an open-source ETL (Extract, Transform, and Load) software which, in this case, is used to extract the most important information from the Moodle database, then transforms and prepares the data to be loaded in a DWH (DataWareHouse).

This guide assumes Docker is already installed and working on the server.

Installation Steps

To execute Docker commands, a user with sudo privileges is required. If the root user is accessible, there is no need to add the ‘sudo’ instruction.

  1. Download the Docker image. At the time of writing this guide, NiFi version 2.0 is still not fully released.

    docker pull apache/nifi:1.27.0

  2. Create a NiFi Docker container using the folllowing command:

    docker run --log-opt max-size=100m --name nifi -e NIFI_WEB_HTTPS_PORT='8443' -e NIFI_WEB_HTTP_HOST='exampledomain.com' -e NIFI_WEB_PROXY_HOST='exampledomain.com:8443' -p 8443:8443 -d apache/nifi:1.27.0 --restart=always

    1. NIFI_WEB_HTTPS_PORT: this is the port where NiFi interface will be served at.

    2. NIFI_WEB_HTTP_HOST: server domain name.

    3. NIFI_WEB_PROXY_HOST: server domain name plus the port.

  3. The credentials to log in to the platform are generated on the first run. Use the following command after doing docker run to see the logs. Look out for Generated Username and Generated Password.

    docker ps docker logs -f <Docker ID>

    To search specifically for the credentials after NiFi is already running:

    docker logs nifi | grep Generated

Official Documentation: Documentation for Version 1

Official Docker Image Instructions: https://hub.docker.com/r/apache/nifi

Importing NiFi Pipelines

 

Related content