HDP部署Tez UI

芒果2年前技术文章1118

首先部署tomcat
在官网下载apache-tomcat-9.0.22.tar.gz
[root@hdp02 opt]# wget https://archive.apache.org/dist/tomcat/tomcat-9/v9.0.22/bin/apache-tomcat-9.0.22.tar.gz
移动到/usr/local下并解压
[root@hdp02 opt]# cd /usr/local/
[root@hdp02 local]# mkdir tomcat
[root@hdp02 local]# tar -xvf apache-tomcat-9.0.22.tar.gz -C tomcat/
  启动tomcat服务
/usr/local/tomcat/apache-tomcat-9.0.22/bin
[root@hdp02 bin]# ./startup.sh
Using CATALINA_BASE:   /usr/local/tomcat/apache-tomcat-9.0.22
Using CATALINA_HOME:   /usr/local/tomcat/apache-tomcat-9.0.22
Using CATALINA_TMPDIR: /usr/local/tomcat/apache-tomcat-9.0.22/temp
Using JRE_HOME:        /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.362.b08-1.el7_9.x86_64/jre
Using CLASSPATH:       /usr/local/tomcat/apache-tomcat-9.0.22/bin/bootstrap.jar:/usr/local/tomcat/apache-tomcat-9.0.22/bin/tomcat-juli.jar
Tomcat started.

检查是否有tomcat进程
[root@hdp02 bin]# lsof -i:8080
COMMAND  PID USER   FD   TYPE   DEVICE SIZE/OFF NODE NAME
java    7053 root   55u  IPv6 92137450      0t0  TCP *:webcache (LISTEN)
访问tomcat界面
http://ip:8080/ 

F478D867-2F8C-4CDA-BCA2-E2660E6F281F.png


下载tez-ui
wget https://dlcdn.apache.org/tez/0.9.2/apache-tez-0.9.2-bin.tar.gz
tar -zxvf apache-tez-0.9.2-bin.tar.gz
cp apache-tez-0.9.2-bin/tez-ui-0.9.2.war /usr/local/tomcat/apache-tomcat-9.0.22/webapps/tez-ui
cd /usr/local/tomcat/apache-tomcat-9.0.22/webapps/tez-ui
unzip tez-ui-0.9.2.war
修改config/configs.env中的内容,主要是timeline和rm的地址
ENV = {
  hosts: {
    /*
     * Timeline Server Address:
     * By default TEZ UI looks for timeline server at http://localhost:8188, uncomment and change
     * the following value for pointing to a different address.
     */
    //timeline: "http://172.16.120.50:8188",
    /*
     * Resource Manager Address:
     * By default RM REST APIs are expected to be at http://localhost:8088, uncomment and change
     * the following value to point to a different address.
     */
    //rm: "http://172.16.120.50:8088",
    /*
     * Resource Manager Web Proxy Address:
     * Optional - By default, value configured as RM host will be taken as proxy address
     * Use this configuration when RM web proxy is configured at a different address than RM.
     */
    //rmProxy: "http://172.16.120.51:8088",
  }
在tez目录下修改/添加tez-site.xml
<property>
  <description>Enable Tez to use the Timeline Server for History Logging</description>
  <name>tez.history.logging.service.class</name>
  <value>org.apache.tez.dag.history.logging.proto.ProtoHistoryLoggingService</value>
</property>
<property>
  <description>URL for where the Tez UI is hosted</description>
  <name>tez.tez-ui.history-url.base</name>
  <value>http://172.16.120.51:8088/tez-ui/</value>
</property>
可以选择在界面上添加 

EA77B268-D409-4BFF-84B9-A56B9726D261.png

保持并更新配置-Refresh configs。
添加/修改yarn-site.xml
<property>
  <description>Indicate to clients whether Timeline service is enabled or not.
  If enabled, the TimelineClient library used by end-users will post entities
  and events to the Timeline server.</description>
  <name>yarn.timeline-service.enabled</name>
  <value>true</value>
</property>
<property>
  <description>The hostname of the Timeline service web application.</description>
  <name>yarn.timeline-service.hostname</name>
  <value>localhost</value>
</property>
<property>
  <description>Enables cross-origin support (CORS) for web services where
  cross-origin web response headers are needed. For example, javascript making
  a web services request to the timeline server.</description>
  <name>yarn.timeline-service.http-cross-origin.enabled</name>
  <value>true</value>
</property>
<property>
  <description>Publish YARN information to Timeline Server</description>
  <name> yarn.resourcemanager.system-metrics-publisher.enabled</name>
  <value>true</value>
</property>
或者在ambari中修改,没有的属性添加即可

39E81244-D6FF-4431-9164-C0CC135461CB.png
保存后启动tomcat即可正常运行tez-uis
访问tez-ui
http://ip:8080/tez-ui/
如果出现tez-ui打开没数据 修改yarn-site
yarn.acl.enable=flase










相关文章

Hive优化之SQL的优化(三)

Hive优化之SQL的优化(三)

     Hive是大数据领域常用的组件之一,主要是大数据离线数仓的运算,关于Hive的性能调优在日常工作和面试中是经常涉及的一个点,因此掌握一些Hi...

Hive优化之Spark执行引擎的参数优化(二)

Hive优化之Spark执行引擎的参数优化(二)

        Hive是大数据领域常用的组件之一,主要是大数据离线数仓的运算,关于Hive的性能调优在日常工作和面试中...

helm安装部署trino对接hive(一)

helm安装部署trino对接hive(一)

前提:本文前提是基于hive组件已经提前安装的情况下,安装部署好trino容器之后进行对hive组件的对接。helm trino地址:https://artifacthub.io/packages/h...

CDH实操--hive高可用

CDH实操--hive高可用

前言在CDH中,hive metastore、hiveserver2若角色单实例部署,或者部署多个实例但是连接配置任选其一的话,均存在单点问题,一旦实例故障就会影响业务稳定;这时我们就好考虑高可用部署...

hive执行count和spark执行count结果不一致

hive执行count和spark执行count结果不一致

【组件版本】hive on mr、spark【问题现象】hive 执行count语句,结果条数为0,spark执行count语句能正常显示count数【详细描述】hive 执行count语句:显示co...

Hive架构图及Hive SQL的执行流程

Hive架构图及Hive SQL的执行流程

1、Hive产生背景MapReduce编程的不便性HDFS上的文件缺少Schema(表名,名称,ID等,为数据库对象的集合)2、Hive是什么Hive的使用场景是什么?基于Hadoop做一些数据清洗啊...

发表评论    

◎欢迎参与讨论,请在这里发表您的看法、交流您的观点。