Automated Export of Cloudera Manager Configuration for Hadoop

Cloudera Manager is a web based management application for your Apache Hadoop cluster. It makes the installation and configuration for your Hadoop cluster a whole lot easier and is free for a cluster up to 50 nodes. In particular I like the suggested configuration settings based on your cluster hardware. All the configuration settings of Cloudera Manager are persisted in the configuration database, which can be manually exported through the admin interface. One of our clients wanted to export these settings programmatically for auditing and backup purposes. Currently there isn't an automated way to do that, besides backing up the entire database. Here is a little shell script that allows you to download the configuration automatically in text format. [java] #!/bin/bash USERNAME=admin PASSWORD=admin SCM_URL=https://xebia.com/blog:7180 COOKIES_FILE=cookies.txt EXPORT_FILE=export.txt wget -q --post-data="j_username=${USERNAME}&j_password=${PASSWORD}" --save-cookies ${COOKIES_FILE} --keep-session-cookies -O /dev/null ${SCM_URL}/j_spring_security_check wget -q -O ${EXPORT_FILE} --load-cookies ${COOKIES_FILE} ${SCM_URL}/cmf/exportCLI [/java] Adjust the variables for your Cloudera Manager setup. Download the export-scm-config.sh script and follow @mids106 on Twitter.