Cloudera CDH cluster setup: Cloudera Manager agents installation

If you followed previous guides related Cloudera CDH cluster setup either on this site or on my youtube channel, you are ready to proseed with the next step – installation of Cloudera Maanger agents on all cluster nodes, including Cloudera Maanger Server node.

Start all your nodes and wait until load is finished. Then open you web-browser and point it to Cloudera Manager GUI. If we followed my guides / have not changed anything, then the address should be http://localhost:7180
You will be asked to enter a login and password. Once again, if you have not changed any default settings, it should be both login and passowrd “admin”

Once you are on the welcome screen, just press “Continue” on the left bottom coner as per screenshot below

CDH Manager welcome screen

Once pressed, you will be asked to accept a licence agreements. Just read it through carefully, check the box that you accept the agreement and press “Continue”

Once the screen you should choose the version of Cloudera Manager to use in you clsuter. As per screenshot below three options exist:
-Cloudera Express is the free version of Cloudera Manager. Does not require and licence and is absoultely free. Only basic functionality is available of Cloudera Manager is available here.
-Cloudera Exterprise Trial is a paid version of Cloudera Manager. 60-day trial is avaialable, once expired there are two options – either you buy a licence and continue using Enterprise edition or your Cloudera Manager will be automatically downgraded to Cloudera Express. As we dont risk with anything, let’s choose this option to explore the functionality offered by Cloudera Manager
-Cloudera Enterprise. You already have a licence and select this option and provide a key. Probably not the case for use 🙂

Choosing a version of Cloudera Manager

By pressing “Continue” we are moving to the process of our clsuter setup (finally!!!). On the first screen you are asked to give a name for your cluster – you can give any name you wish, since it does not affect anything and is only needed so you can distinguish between your clusters, since Cloudera Manager allows to manage multiple clusters.

On the next screen we shoud provide a list of hosts (either IPs or FQDNs) to be included in our cluster. The most convenient way how to do that is to provide an IP range as per screenshot below.

Selecting cluster nodes

Pay attention that you have to add all nodes, including Cloudera Manager Server node itself (the node on which this GUI works). If everything is fine, you should see all your nodes in the table and they should be all selected by default. Also pay attention that for each node FQDN is resolved as well. Once it is done, press “Continue”

On the next screen, you should not change any options, just use the options by default – Cloudera public repository as the source of parcels, use parcels as the method of installation, the latest version of CDH distribution should be already selected. At this point of time, do not install any additional parcels, we will do that later on when needed. Once finised, press “Continue”

What to install and from where

On the next screen you are asked to accept two licence agreements, just do that and press “Continue”.

As per screenshot below, next you need to provide login / password, so Cloudera Manager could SSH to each of your nodes, install and configure everything. Please note, that login should be the same for all hosts, however, password, could differ. In my exampe I used my user “dmitrijsf” and password, which is the same across all nodes. Please pay attention, that sudo option should be available for this particular user without being asked for a password. Cloudera reminds you about that and that’s what we already did last time 🙂

SSH connectivity configuration

Once you press “Continue”, the installation process will start as per screen below. It will require some time, since a few GBs of data should be downloaded from Cloudera repository. Just be patient!

Cloudera Manager agents installation

Once installation of agents is completed, some default parcels will be downloaded and installed, no actions are required from your side as per screenshot below.

Parcels installation

Once it is completed, we are on the last screen of cluster isntallation, where we are offered to test network performance and some variables values as per screen below.

Cluster installatiob check

You will not be able to press a button “Continue” until you do the checks. Everything should be fine, however, during the action of “Check Hosts” you can get some warnings that Cloudera recommended settings do not match the ones you have on your nodes. You can try either to fix them by pressing the button “Show inspector results”, you will get a detailed report and some advices what and how to change. As alternative, you can select and option (radio-button) “I understand the risks, let me continue with cluster setup”. Once you select it and press “Continue”, installation is finished! So the cluster as such is installed, but still we need to configure it. That will be done during the next video / post 🙂

If you still have any questions or something is not clear, do not hesitate to ask in the comments 🙂

Do not forget to bookmark this site and also subscribe to my YouTube channel, stay turned and see you next time!

YouTube channel with BigData and Java tutorials

Leave a Reply