Azkaban Install and Schedule Job-阿里云开发者社区

Azkaban Install and Schedule Job

2017-04-21 1401

版权

本文内容由阿里云实名注册用户自发贡献，版权归原作者所有，阿里云开发者社区不拥有其著作权，亦不承担相应法律责任。具体规则请查看《阿里云开发者社区用户服务协议》和《阿里云开发者社区知识产权保护指引》。如果您发现本社区中有涉嫌抄袭的内容，填写侵权投诉表单进行举报，一经查实，本社区将立刻删除涉嫌侵权内容。

简介： 1.git clone and buid [root@sht-sgmhadoopdn-04 app]# git clone https://github.com/azkaban/azkaban.

1.git clone and buid
[root@sht-sgmhadoopdn-04 app]# git clone https://github.com/azkaban/azkaban.git
[root@sht-sgmhadoopdn-04 app]# cd azkaban
[root@sht-sgmhadoopdn-04 azkaban]# ./gradlew build
[root@sht-sgmhadoopdn-04 azkaban]# cd azkaban-solo-server/build/distributions/
[root@sht-sgmhadoopdn-04 distributions]# ll
total 46372
-rw-r--r-- 1 root root 23678999 Apr 21 14:17 azkaban-solo-server-3.21.0-6-g102226a.tar.gz
-rw-r--r-- 1 root root 23800311 Apr 21 14:17 azkaban-solo-server-3.21.0-6-g102226a.zip
[root@sht-sgmhadoopdn-04 distributions]# cp azkaban-solo-server-3.21.0-6-g102226a.tar.gz ~/learnproject/app/

2.tar and modify parameter
[root@sht-sgmhadoopdn-04 distributions]# cd ~/learnproject/app/
[root@sht-sgmhadoopdn-04 app]# tar -xzvf azkaban-solo-server-3.21.0-6-g102226a.tar.gz
[root@sht-sgmhadoopdn-04 app]# mv azkaban-solo-server-3.21.0-6-g102226a azkaban-3.21.0
[root@sht-sgmhadoopdn-04 app]# cd azkaban-3.21.0

[root@sht-sgmhadoopdn-04 azkaban-3.21.0]# cd conf
[root@sht-sgmhadoopdn-04 conf]# ll
total 8
-rw-r--r-- 1 root root 941 Apr 21 14:08 azkaban.properties
-rw-r--r-- 1 root root 265 Apr 21 14:08 azkaban-users.xml
-rw-r--r-- 1 root root 0 Apr 21 14:08 global.properties
[root@sht-sgmhadoopdn-04 conf]# vi azkaban.properties
default.timezone.id=Asia/Shanghai

3.start and open
[root@sht-sgmhadoopdn-04 azkaban-3.21.0]# ./bin/azkaban-solo-start.sh
...........
2017/04/21 14:26:13.219 +0800 INFO [log] [Azkaban] jetty-6.1.26
2017/04/21 14:26:13.221 +0800 INFO [log] [Azkaban] Started SocketConnector@0.0.0.0:12321
2017/04/21 14:26:13.226 +0800 INFO [AzkabanExecutorServer] [Azkaban] Started Executor Server on sht-sgmhadoopdn-04:12321
2017/04/21 14:26:13.226 +0800 INFO [AzkabanWebServer] [Azkaban] Azkaban Exec Server started...

open web: http://sht-sgmhadoopdn-04:8081/ azkaban/azkaban

4.create project:loganalysis

5.create the file hour_logtype_count.job

点击(此处)折叠或打开

type=command
# 执行sh脚本，建议这样做，后期只需维护脚本就行了，azkaban定义工作流程
command=ssh hive@sht-sgmhadoopnn-02 "/tmp/hour_logtype_count.sh"

6.zip the file hour_logtype_count.job to hour_logtype_count.zip

7.click Upload, select hour_logtype_count.zip

8.set schedule time: 0 5 * ? * *

9.run the hour_logtype_count