Monday 26 September 2016

Install NiFi in Spark HDInsight Cluster

sudo mkdir tars

cd tars/

sudo wget http://public-repo-1.hortonworks.com/HDF/ubuntu14/1.x/updates/1.2.0.1/HDF-1.2.0.1-1.tar.gz

sudo chmod -R 777 /home/admin123/tars/HDF-1.2.0.1-1.tar.gz

sudo tar -xzvf /home/admin123/tars/HDF-1.2.0.1-1.tar.gz

sudo chmod -R 777 /home/admin123/tars/HDF-1.2.0.1-1

sudo vi /home/admin123/tars/HDF-1.2.0.1-1/nifi/conf/nifi.properties
   change port 8095 (webservices)
   change key: (security)

cd /home/admin123/tars/HDF-1.2.0.1-1/nifi/bin/

sudo ./nifi.sh install

sudo service nifi status

sudo service nifi start

hostname -f

Copy the url
http://hn0-linuxh.xxxxxxxxxxxxxxxxxymrxnfih0c.ix.internal.cloudapp.net:8095/nifi/
Posted by at
Labels: ,

4 comments:

  1. dalgual22 April 2017 at 23:27

    Can you specify more in detail at changing port and key?:
    sudo vi /home/admin123/tars/HDF-1.2.0.1-1/nifi/conf/nifi.properties
    change port 8095 (webservices)
    change key: (security)

    I guess it is to update the following port:
    nifi.web.http.port=8095

    What key property value I need to change? And, what should be its value?

    ReplyDelete
  2. dalgual22 April 2017 at 23:39

    And, the following is an internal host name:
    http://hn0-linuxh.xxxxxxxxxxxxxxxxxymrxnfih0c.ix.internal.cloudapp.net:8095/nifi/

    How can you open it in a web browser?

    ReplyDelete
  3. dalgual23 April 2017 at 00:10

    I got it.

    You need to tunnel your web browser to HDinsight server. First, you have to enter the following command to your local shell terminal.
    ssh -L 8080:localhost:8095 user_ssh@[yourcluster_ssh]-ssh.azurehdinsight.net

    Then, open your web browser and type in “http://localhost:8080/nifi” . Then, it will forward to azurehdinsight server to open NiFi Web UI.

    ReplyDelete
    Replies
    1. Profounder22 March 2018 at 01:36

      This comment has been removed by the author.

      Delete

Subscribe to: Post Comments (Atom)