Sunday 20 September 2015

Enable GUI for Ubuntu in Azure

Steps : 

1)   sudo apt-get update

2)   sudo apt-get install ubuntu-desktop (This step will take time, please be patient)

3)   sudo apt-get install xrdp

4)   sudo /etc/init.d/xrdp start

5)   sudo adduser brillio

6)   sudo adduser lokesh

7)   sudo adduser lokesh sudo

8)   Download the RDP from Azure and connect using username : lokesh(in my case) and password as given in step 6

Monday 7 September 2015

Python Machine Learning Library installation


sudo easy_install pip
sudo pip install numpy
sudo easy_install gevent
sudo yum install g++ (for centOS)
sudo apt-get install g++(for ubuntu)
sudo pip install pandas
sudo pip install sklearn
sudo pip install nltk
sudo pip install geopy
sudo pip install tweepy
sudo pip install scipy

In case of Error in installing (Scipy)

raise NotFoundError('no lapack/blas resources found')(centOS)
sudo yum install python-devel
sudo yum install libevent-devel
sudo yum install scipy

raise NotFoundError('no lapack/blas resources found')(ubuntu)
sudo apt-get install gfortran libopenblas-dev liblapack-dev

Thursday 3 September 2015

Check for port

# Sample example to check MySql port

sudo netstat -tlpn | grep mysql

 sudo netstat -plnt | grep ':61181'

Tuesday 1 September 2015

Backup Table and Data in HBase

Use following command :

snapshot 'tweets1', 'tweets1-Snapshot'
clone_snapshot 'tweets1-Snapshot', 'newTable'


//tweets1 is the actual table name.
//newTable is the cloned table. Type in command  -- scan 'newTable'to verify.

Hbase Error:Resolved

su - hbase -c "/usr/hdp/current/hbase-master/bin/hbase-daemon.sh start master; sleep 25"

su - hbase -c "/usr/hdp/current/hbase-regionserver/bin/hbase-daemon.sh start regionserver"

  1. Check processes.
    ps -ef | grep -i hmaster
    ps -ef | grep -i hregion

Copy Files from one Linux Machine to Another in Azure

Use the command below to copy :


scp -C -i myPrivateKey_rsa -r /home/brillio/move.txt brillio@your_target_hostname.cloudapp.net:/home/brillio/


hadoop distcp hdfs://your_hostname:8020/training/BSA hdfs://your_target_hostname:8020/training/BSA/