I have 4 Hadoop environments, all running distribution Hortonworks, versions are either 2.3.4 or 2.4. I have installed HDFS, MapReduce and YARN first and the need is to add Hive.

When installing Hive, Pig and Tez follow with it whether you want it or not.

I already have an existing MySql database (because of Ranger) and this post describes how to install Hive and use an existing MySql for metastore. Installing Hive with a new MySql is actually easier.

1. On Ambari server, from the CLI, run the following

   sudo ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java.jar
   

   Output:

   Using python  /usr/bin/python
   Setup ambari-server
   Copying /usr/share/java/mysql-connector-java.jar to /var/lib/ambari-server/resources
   JDBC driver was successfully initialized.
   Ambari Server ‘setup’ completed successfully.

2. Log in to Ambari as administrator
3. From the Actions drop down menu on the left side of the screen, click Add Service
   
4. Choose services
   Check services Tez, Hive and Pig. If you pick only Hive, the installation wizard will remind you that you have to set up Tez and Pig packages as well.
   
5. Assign masters
   In this case, I am installing Hive on my namenode. This can always be changed – it is possible to move services to other instances (why do you think my namenode is called md-namenode2? ;))
   
6. Assign Slaves and Clients
   Tez Client, HCat Client, Hive Client and Pig Client are going to be installed to this host(s).
   In this case I am installing it on the same server as Hive server, on “more serious” clusters I install the clients where they belong – the client server.
   
7. Customize Services
   On the MySql Server used for Hive metastore run the following commands as root

   CREATE USER 'hive'@'localhost' IDENTIFIED BY 'hive';
   CREATE USER 'hive'@'%' IDENTIFIED BY 'hive';
   FLUSH PRIVILEGES;
   

    

8. Set up connection string to the metastore
   Choose “Existing MySQL Database”

   Note: If there is a problem connecting to the database when testing the connection, check also in the my.cnf on the MySql server if the following property is uncommented:

   bind-address           = 127.0.0.1

   Comment it (# in front of the line), since we are connecting to the server from other hosts than localhost.

9. Review
   
   If the installation details are acceptable, proceed with the installation.
10. When the installation is complete. The installed services are now available
    
    Do not forget to restart the services if Ambari suggests so!

Error during installation

resource_management.core.exceptions.Fail: Applying Directory[‘/usr/hdp/2.4.0.0-169/tez/conf’] failed, looped symbolic links found while resolving /etc/tez/conf

The solution to it run the following on the Hive server (md-namenode2 in this example):

unlink /etc/tez/conf