Cloudera Manager (CM), a cloudera tool to setup, manage and monitor hadoop cluster and other components in a Hadoop Cluster.
How it works?
- CM will be running on one machine in the cluster
- Cloudera agent will be running on all machines in the cluster
- Cloudera agent sends data collected from all machines such as resource utilization (memory, storage, cpu etc)
- Data will be stored in a relational database which will act as repository
- Cloudera Manager consolidates this information and provides capabilities such as alerts, dashboards etc.
Cloudera Manager components:
- Cloudera Manager Server – web application’s container and core Cloudera Manager engine
- Cloudera Manager Database – web application’s data and monitoring information
- Admin Console – web user interface application
- Cloudera Agent – installed on every component in the cluster
- REST API – for communication with Agents
Cloudera Manager can be installed using the following two methods:
- Automatic installation – For Normal and test environments
- Manual installation – For production cases – Following are steps for manual installation of Cloudera manager.
For this demonstration, we will be using the following machine configuration for the Cloudera Manager Server:
- Operating system: CentOS 7
- RAM: 4 GB
- CPU: 1 CPU core
- Disk space: 60 + 60GB two disks
The following are the steps to set it up
- Setup Local repository
- Set up database for Cloudera Manager
- Install Cloudera Manager
- Start Cloudera Manager
- Enable Cloudera Manager to start on reboots
- Validate by going to url (http://<hostname>:7180)
Here is the order of steps to setup Cloudera Manager: