###1、需求
1、intellij idea打开多个项目
2、每个同学开发一个项目，相互之前独立不影响
3、通过一个入口可以调用所有项目类、方法、属性，达到同时开发且检测代码
4、dependency只需要写一份，其余项目不用写，便可全部依赖
###2、注意事项（非常重要）
6个坑：
1、<groupid>com.yh.bi</groupid>
项目中所有的groupid要一样
2、避免循环依赖，导致程序报错
3、<scope>provided</scope>
打包的服务器运行时候需要provided，本机调试的时候，需要注释
在一个maven项目中，如果存在编译需要而发布不需要的jar包，可以用scope标签，值设为provided
4、项目、module建好之后需要添加scala的框架支持
5、在yhproject中，可以统一对所有的module进行清理、编译、打包
6、要运行依赖中的module，则必须要将module中的jar包，打到maven中，需要使用install
下面，是我将所有module中的jar打到maven中的路径：
###3、建立project和建立module
1、只需要建立一个项目，其他项目由module建立，所有module且放在项目中。
2、本文项目为yhproject，其余都为module，分别是：mainentrance、yhutils、yhapp、yhweb、yhgame
项目建立步鄹：
module建立步鄹：
###4、项目之前的依赖关系
###5、代码展示
mainentrance
package com.yh.bi.dag
?
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
|
package com.yh.bi.dag
/**
* created by yuhui on 2017/2/10.
*/
import java.time.{duration, localdate}
import com.yh.bi._
import com.yh.bi.{userapp, usergame, userweb}
import org.slf4j.loggerfactory
import scala.collection.immutable.{listmap, listset}
/**
* created by yuhui on 2016/8/25.
* task --> node --> dag --> dagexecutor
*/
case class node[t](task: t, parent: t*) {
override def tostring: string = {
s"$task(${parent.mkstring(",")})"
}
}
case class dag[t](nodes: node[t]*)
case class dagexecutor[t](dag: dag[t]) {
private val log = loggerfactory.getlogger(this.getclass)
private val _nodes: map[t, seq[t]] = dag.nodes.map(node => (node.task, node.parent.filter(_ != null))).tomap
private var _pending: set[t] = listset()
private var _fails = listmap[t, string]()
private var _success = seq[t]()
//判断node的task节点的父节点运行状态（flase ，true）
private def getpending: option[t] = {
_pending.find { name =>
val parents = _nodes(name)
!parents.exists(name => !_success.contains(name))
}
}
private def fail(name: t, message: string): unit = {
_pending -= name
_fails += name -> message
for (child <- _pending.filter(child => _nodes(child).contains(name))) {
fail(child, s"依赖的任务无法执行: $name")
}
}
private def success(name: t): unit = {
_pending -= name
_success = _success :+ name
}
def execute(func: t => unit): unit = {
_pending = _nodes.keyset
_fails = listmap()
_success = seq()
var running = true
while (running) {
val taskopt = getpending
if (taskopt.nonempty) {
val task = taskopt.get
val startmills = system.currenttimemillis()
log.info("start task {}", task)
try {
println("=============")
func(task) //执行executor方法
println("+++++++++++++")
val time = duration.ofmillis(system.currenttimemillis() - startmills)
log.info(s"end task $task time=$time")
success(task)
} catch {
case e: throwable => fail(task, e.getmessage)
log.error(e.getmessage, e)
log.info(s"fail task $task")
}
} else {
running = false
}
}
for (name <- _success) {
log.info(s"success task: $name")
}
for (name <- _fails) {
log.info(s"fail task: ${name._1} - ${name._2}")
}
}
}
object dag {
val allsdkdag = new dag[task](
node(userapp),
node(usergame),
node(userweb)
)
def main(args: array[string]): unit = {
dagexecutor(allsdkdag).execute { task =>task.executor("appkey": string, localdate.now(), localdate.now())}
}
}
|
yhutils
?
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
|
package com.yh.bi
/**
* created by yuhui on 2017/2/10.
*/
import java.time.localdate
import org.apache.spark.sql.sqlcontext
import org.slf4j.loggerfactory
abstract class executor extends task with sqlcontextaware {
override def run(appkey: string, startday: localdate, endday: localdate)={}
}
trait sqlcontextaware {
implicit var ctx: sqlcontext = _
}
abstract class task {
protected val log = loggerfactory.getlogger(this.getclass)
def executor(appkey: string, startday: localdate, endday: localdate): unit
def run(appkey: string, startday: localdate, endday: localdate): unit = {
executor(appkey, startday, endday)
}
}
|
yhapp
?
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
|
package com.yh.bi
/**
* created by yuhui on 2017/2/10.
*/
import java.time.localdate
object userapp extends executor{
override def executor(appkey: string, startday: localdate, endday: localdate): unit = {
println("++++我的userapp的执行过程++++")
}
}
|
yhweb
?
|
1
2
3
4
5
6
7
8
9
10
11
12
13
|
package com.yh.bi
import java.time.localdate
object userweb extends executor{
override def executor(appkey: string, startday: localdate, endday: localdate): unit = {
println("++++我的userweb的执行过程++++")
}
}
|
yhgame
?
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
|
package com.yh.bi
/**
* created by yuhui on 2017/2/10.
*/
import java.time.localdate
object usergame extends executor{
override def executor(appkey: string, startday: localdate, endday: localdate): unit = {
println("++++我的usergame的执行过程++++")
}
}
|
###6、项目中pom依赖展示
yhproject中pom文件展示：
?
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
|
<?xml version="1.0" encoding="utf-8"?>
<project xmlns="http://maven.apache.org/pom/4.0.0"
xmlns:xsi="http://www.w3.org/2001/xmlschema-instance"
xsi:schemalocation="http://maven.apache.org/pom/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
<modelversion>4.0.0</modelversion>
<groupid>com.yh.bi</groupid>
<artifactid>yhproject</artifactid>
<packaging>pom</packaging>
<version>1.0</version>
<modules>
<module>mainentrance</module>
<module>yhapp</module>
<module>yhweb</module>
<module>yhgame</module>
<module>yhutils</module>
</modules>
</project>
|
mainentrance中pom文件展示：
?
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
|
<?xml version="1.0" encoding="utf-8"?>
<project xmlns="http://maven.apache.org/pom/4.0.0"
xmlns:xsi="http://www.w3.org/2001/xmlschema-instance"
xsi:schemalocation="http://maven.apache.org/pom/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
<modelversion>4.0.0</modelversion>
<artifactid>mainentrance</artifactid>
<groupid>com.yh.bi</groupid>
<version>1.0</version>
<dependencies>
<dependency>
<artifactid>yhutils</artifactid>
<groupid>com.yh.bi</groupid>
<version>1.0</version>
<!--<scope>provided</scope> //本机调试则注释， 集群运行则解开-->
</dependency>
<dependency>
<artifactid>yhapp</artifactid>
<groupid>com.yh.bi</groupid>
<version>1.0</version>
<!--<scope>provided</scope>-->
</dependency>
<dependency>
<artifactid>yhgame</artifactid>
<groupid>com.yh.bi</groupid>
<version>1.0</version>
<!--<scope>provided</scope>-->
</dependency>
<dependency>
<artifactid>yhweb</artifactid>
<groupid>com.yh.bi</groupid>
<version>1.0</version>
<!--<scope>provided</scope>-->
</dependency>
</dependencies>
<build>
<plugins>
<plugin>
<groupid>org.apache.maven.plugins</groupid>
<artifactid>maven-compiler-plugin</artifactid>
<configuration>
<source>1.8</source>
<target>1.8</target>
</configuration>
</plugin>
<plugin>
<groupid>org.apache.maven.plugins</groupid>
<artifactid>maven-shade-plugin</artifactid>
<version>2.4</version>
<configuration>
<filters>
<filter>
<artifact>*:*</artifact>
<excludes>
<exclude>**/log4j2.*</exclude>
<exclude>meta-inf/*.sf</exclude>
<exclude>meta-inf/*.dsa</exclude>
<exclude>meta-inf/*.rsa</exclude>
</excludes>
</filter>
</filters>
<!-- put your configurations here -->
</configuration>
<executions>
<execution>
<phase>package</phase>
<goals>
<goal>shade</goal>
</goals>
<configuration>
<outputfile>${project.build.directory}/${project.artifactid}.jar
</outputfile>
</configuration>
</execution>
</executions>
</plugin>
</plugins>
<sourcedirectory>src/main/scala</sourcedirectory>
<resources>
<resource>
<directory>${basedir}/src/main/resources</directory>
<includes>
<include>**/*</include>
</includes>
</resource>
</resources>
</build>
</project>
|
yhutils中pom文件展示：
?
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
|
<?xml version="1.0" encoding="utf-8"?>
<project xmlns="http://maven.apache.org/pom/4.0.0"
xmlns:xsi="http://www.w3.org/2001/xmlschema-instance"
xsi:schemalocation="http://maven.apache.org/pom/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
<parent>
<artifactid>yhproject</artifactid>
<groupid>com.yh.bi</groupid>
<version>1.0</version>
</parent>
<modelversion>4.0.0</modelversion>
<artifactid>yhutils</artifactid>
<dependencies>
<dependency>
<groupid>org.apache.spark</groupid>
<artifactid>spark-hive_2.11</artifactid>
<version>1.6.1</version>
</dependency>
</dependencies>
<build>
<plugins>
<plugin>
<groupid>org.apache.maven.plugins</groupid>
<artifactid>maven-compiler-plugin</artifactid>
<configuration>
<source>1.8</source>
<target>1.8</target>
</configuration>
</plugin>
<plugin>
<groupid>org.apache.maven.plugins</groupid>
<artifactid>maven-shade-plugin</artifactid>
<version>2.4</version>
<configuration>
<filters>
<filter>
<artifact>*:*</artifact>
<excludes>
<exclude>**/log4j2.*</exclude>
<exclude>meta-inf/*.sf</exclude>
<exclude>meta-inf/*.dsa</exclude>
<exclude>meta-inf/*.rsa</exclude>
</excludes>
</filter>
</filters>
<!-- put your configurations here -->
</configuration>
<executions>
<execution>
<phase>package</phase>
<goals>
<goal>shade</goal>
</goals>
<configuration>
<outputfile>${project.build.directory}/${project.artifactid}.jar
</outputfile>
</configuration>
</execution>
</executions>
</plugin>
</plugins>
<sourcedirectory>src/main/scala</sourcedirectory>
<resources>
<resource>
<directory>${basedir}/src/main/resources</directory>
<includes>
<include>**/*</include>
</includes>
</resource>
</resources>
</build>
</project>
|
yhapp中pom文件展示：
?
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
|
<?xml version="1.0" encoding="utf-8"?>
<project xmlns="http://maven.apache.org/pom/4.0.0"
xmlns:xsi="http://www.w3.org/2001/xmlschema-instance"
xsi:schemalocation="http://maven.apache.org/pom/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
<modelversion>4.0.0</modelversion>
<groupid>com.yh.bi</groupid>
<artifactid>yhapp</artifactid>
<version>1.0</version>
<dependencies>
<dependency>
<artifactid>yhutils</artifactid>
<groupid>com.yh.bi</groupid>
<version>1.0</version>
<scope>provided</scope>
</dependency>
</dependencies>
<build>
<plugins>
<plugin>
<groupid>org.apache.maven.plugins</groupid>
<artifactid>maven-compiler-plugin</artifactid>
<configuration>
<source>1.8</source>
<target>1.8</target>
</configuration>
</plugin>
<plugin>
<groupid>org.apache.maven.plugins</groupid>
<artifactid>maven-shade-plugin</artifactid>
<version>2.4</version>
<configuration>
<filters>
<filter>
<artifact>*:*</artifact>
<excludes>
<exclude>**/log4j2.*</exclude>
<exclude>meta-inf/*.sf</exclude>
<exclude>meta-inf/*.dsa</exclude>
<exclude>meta-inf/*.rsa</exclude>
</excludes>
</filter>
</filters>
<!-- put your configurations here -->
</configuration>
<executions>
<execution>
<phase>package</phase>
<goals>
<goal>shade</goal>
</goals>
<configuration>
<outputfile>${project.build.directory}/${project.artifactid}.jar
</outputfile>
</configuration>
</execution>
</executions>
</plugin>
</plugins>
<sourcedirectory>src/main/scala</sourcedirectory>
<resources>
<resource>
<directory>${basedir}/src/main/resources</directory>
<includes>
<include>**/*</include>
</includes>
</resource>
</resources>
</build>
</project>
|
yhweb中pom文件展示：
?
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
|
<?xml version="1.0" encoding="utf-8"?>
<project xmlns="http://maven.apache.org/pom/4.0.0"
xmlns:xsi="http://www.w3.org/2001/xmlschema-instance"
xsi:schemalocation="http://maven.apache.org/pom/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
<modelversion>4.0.0</modelversion>
<groupid>com.yh.bi</groupid>
<artifactid>yhweb</artifactid>
<version>1.0</version>
<dependencies>
<dependency>
<artifactid>yhutils</artifactid>
<groupid>com.yh.bi</groupid>
<version>1.0</version>
<scope>provided</scope>
</dependency>
</dependencies>
<build>
<plugins>
<plugin>
<groupid>org.apache.maven.plugins</groupid>
<artifactid>maven-compiler-plugin</artifactid>
<configuration>
<source>1.8</source>
<target>1.8</target>
</configuration>
</plugin>
<plugin>
<groupid>org.apache.maven.plugins</groupid>
<artifactid>maven-shade-plugin</artifactid>
<version>2.4</version>
<configuration>
<filters>
<filter>
<artifact>*:*</artifact>
<excludes>
<exclude>**/log4j2.*</exclude>
<exclude>meta-inf/*.sf</exclude>
<exclude>meta-inf/*.dsa</exclude>
<exclude>meta-inf/*.rsa</exclude>
</excludes>
</filter>
</filters>
<!-- put your configurations here -->
</configuration>
<executions>
<execution>
<phase>package</phase>
<goals>
<goal>shade</goal>
</goals>
<configuration>
<outputfile>${project.build.directory}/${project.artifactid}.jar
</outputfile>
</configuration>
</execution>
</executions>
</plugin>
</plugins>
<sourcedirectory>src/main/scala</sourcedirectory>
<resources>
<resource>
<directory>${basedir}/src/main/resources</directory>
<includes>
<include>**/*</include>
</includes>
</resource>
</resources>
</build>
</project>
|
yhgame中pom文件展示：
?
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
|
<?xml version="1.0" encoding="utf-8"?>
<project xmlns="http://maven.apache.org/pom/4.0.0"
xmlns:xsi="http://www.w3.org/2001/xmlschema-instance"
xsi:schemalocation="http://maven.apache.org/pom/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
<modelversion>4.0.0</modelversion>
<groupid>com.yh.bi</groupid>
<artifactid>yhgame</artifactid>
<version>1.0</version>
<dependencies>
<dependency>
<artifactid>yhutils</artifactid>
<groupid>com.yh.bi</groupid>
<version>1.0</version>
<scope>provided</scope>
</dependency>
</dependencies>
<build>
<plugins>
<plugin>
<groupid>org.apache.maven.plugins</groupid>
<artifactid>maven-compiler-plugin</artifactid>
<configuration>
<source>1.8</source>
<target>1.8</target>
</configuration>
</plugin>
<plugin>
<groupid>org.apache.maven.plugins</groupid>
<artifactid>maven-shade-plugin</artifactid>
<version>2.4</version>
<configuration>
<filters>
<filter>
<artifact>*:*</artifact>
<excludes>
<exclude>**/log4j2.*</exclude>
<exclude>meta-inf/*.sf</exclude>
<exclude>meta-inf/*.dsa</exclude>
<exclude>meta-inf/*.rsa</exclude>
</excludes>
</filter>
</filters>
<!-- put your configurations here -->
</configuration>
<executions>
<execution>
<phase>package</phase>
<goals>
<goal>shade</goal>
</goals>
<configuration>
<outputfile>${project.build.directory}/${project.artifactid}.jar
</outputfile>
</configuration>
</execution>
</executions>
</plugin>
</plugins>
<sourcedirectory>src/main/scala</sourcedirectory>
<resources>
<resource>
<directory>${basedir}/src/main/resources</directory>
<includes>
<include>**/*</include>
</includes>
</resource>
</resources>
</build>
</project>
|
###7、运行结果展示
注意：我在mainentrance执行dag中的main文件，可以调用且执行了yhutils、yhapp、yhweb、yhgame中的代码
###8、如果建立java 的module
以上就是本文的全部内容，希望对大家的学习有所帮助，也希望大家多多支持快网idc。
原文链接：https://blog.csdn.net/silentwolfyh/article/details/54970108?utm_source=blogxgwz2
相关文章
猜你喜欢
- ASP.NET自助建站系统的数据库备份与恢复操作指南 2025-06-10
- 个人网站服务器域名解析设置指南：从购买到绑定全流程 2025-06-10
- 个人网站搭建：如何挑选具有弹性扩展能力的服务器？ 2025-06-10
- 个人服务器网站搭建：如何选择适合自己的建站程序或框架？ 2025-06-10
- 64M VPS建站：能否支持高流量网站运行？ 2025-06-10
