博客
关于我
强烈建议你试试无所不能的chatGPT,快点击我
docker系列3:docker搭建CDH集群[单机单节点]
阅读量:2110 次
发布时间:2019-04-29

本文共 3771 字,大约阅读时间需要 12 分钟。

官方文档1:

官方文档2:

  • 1, 使用docker 拉取cdh的docker镜像
  • 2, 运行容器
  • 3, 进入容器启动cloudera服务
  • 4, 通过web访问:
服务名称 账户 密码
7180-web控制台 cloudera cloudera
hue cloudera cloudera
mysql root cloudera

拉取cdh的docker镜像, 运行容器

###1, 使用docker 拉取cdh的docker镜像, 运行容器root@wang-pc:/var/lib/docker# docker pull cloudera/quickstartroot@wang-pc:/var/lib/docker# docker run \ -id \ --hostname=quickstart.cloudera \--privileged=true  \ -p 8020:8020 -p 7180:7180 -p 21050:21050 -p 50070:50070 -p 50075:50075 \ -p 50010:50010 -p 50020:50020 -p 8890:8890 -p 60010:60010 -p 10002:10002  \ -p 25010:25010 -p 25020:25020 -p 18088:18088 -p 8088:8088 -p 19888:19888 \ -p 7187:7187 -p 11000:11000 -t -p 8888:8888 \ --name=mycdh3 \ cloudera/quickstart /usr/bin/docker-quickstart d805d3c51b3f4c41c68fe2f3ba923f7e710b7f3c987b990b63a8fda9ee7bec4aroot@wang-pc:/var/lib/docker# docker psCONTAINER ID        IMAGE                 COMMAND                  CREATED             STATUS              PORTS                                                                                                                                                                                                                                                                                                                                                                                                                                                                    NAMESd805d3c51b3f        cloudera/quickstart   "/usr/bin/docker-q..."   5 seconds ago       Up 3 seconds        0.0.0.0:7180->7180/tcp, 0.0.0.0:7187->7187/tcp, 0.0.0.0:8020->8020/tcp, 0.0.0.0:8088->8088/tcp, 0.0.0.0:8888->8888/tcp, 0.0.0.0:8890->8890/tcp, 0.0.0.0:10002->10002/tcp, 0.0.0.0:11000->11000/tcp, 0.0.0.0:18088->18088/tcp, 0.0.0.0:19888->19888/tcp, 0.0.0.0:21050->21050/tcp, 0.0.0.0:25010->25010/tcp, 0.0.0.0:25020->25020/tcp, 0.0.0.0:50010->50010/tcp, 0.0.0.0:50020->50020/tcp, 0.0.0.0:50070->50070/tcp, 0.0.0.0:50075->50075/tcp, 0.0.0.0:60010->60010/tcp   mycdh3

1, cloudera-manager启动脚本分析

/home/cloudera/cloudera-manager:

# cm server启动log 'Starting Cloudera Manager server...'service cloudera-scm-server start 2>&1 > /dev/null# cm agent启动log 'Starting Cloudera Manager agent...'service cloudera-scm-agent start 2>&1 > /dev/null

2, 进入容器: 启动cdh服务

###, 运行容器, 启动clouderaroot@wang-pc:/var/lib/docker# docker exec -it mycdh3 bash[root@quickstart /]# lsbin  boot  dev  etc  home  lib  lib64  lost+found  media  mnt  opt  packer-files  proc  root  sbin  selinux  srv  sys  tmp  usr  var[root@quickstart /]# /home/cloudera/cloudera-manager --enterprise[QuickStart] Shutting down CDH services via init scripts...kafka-server: unrecognized serviceJMX enabled by defaultUsing config: /etc/zookeeper/conf/zoo.cfg[QuickStart] Disabling CDH services on boot...error reading information on service kafka-server: No such file or directory[QuickStart] Starting Cloudera Manager server...[QuickStart] Waiting for Cloudera Manager API...[QuickStart] Starting Cloudera Manager agent...[QuickStart] Activating trial license for Enterprise...[QuickStart] Configuring deployment...Submitted jobs: 16[QuickStart] Deploying client configuration...Submitted jobs: 17[QuickStart] Starting Cloudera Management Service...Submitted jobs: 25[QuickStart] Enabling Cloudera Manager daemons on boot...________________________________________________________________________________Success! You can now log into Cloudera Manager from the QuickStart VM's browser:    http://quickstart.cloudera:7180    Username: cloudera    Password: cloudera

配置host映射

root@wang-pc:/home/wang# cat /etc/hosts127.0.0.1	localhost wang-pc quickstart.cloudera

在这里插入图片描述

测试hdfs, yarn 是否正常

su hdfscd ; echo "a,b,c">a.txt; hdfs dfs -put a.txt /hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar wordcount /a.txt /mapred-out-wc.txt

转载地址:http://dtdef.baihongyu.com/

你可能感兴趣的文章
PAT1090 Highest Price in Supply Chain 树DFS
查看>>
(PAT 1096) Consecutive Factors (质因子分解)
查看>>
(PAT 1019) General Palindromic Number (进制转换)
查看>>
(PAT 1073) Scientific Notation (字符串模拟题)
查看>>
(PAT 1080) Graduate Admission (排序)
查看>>
Play on Words UVA - 10129 (欧拉路径)
查看>>
mininet+floodlight搭建sdn环境并创建简答topo
查看>>
【linux】nohup和&的作用
查看>>
【UML】《Theach yourself uml in 24hours》——hour4
查看>>
Set、WeakSet、Map以及WeakMap结构基本知识点
查看>>
【NLP学习笔记】(一)Gensim基本使用方法
查看>>
【NLP学习笔记】(二)gensim使用之Topics and Transformations
查看>>
【深度学习】LSTM的架构及公式
查看>>
【深度学习】GRU的结构图及公式
查看>>
【python】re模块常用方法
查看>>
剑指offer 19.二叉树的镜像
查看>>
剑指offer 20.顺时针打印矩阵
查看>>
剑指offer 21.包含min函数的栈
查看>>
剑指offer 23.从上往下打印二叉树
查看>>
剑指offer 25.二叉树中和为某一值的路径
查看>>