scan
A data scan tool lib(一个数据扫描的工具包)
Version
1.0.0
Relative
Same project with similar aims in my site, will deprecated, and discourage to use.
scanner
scanner-redis
etl-lib
Features
- with queue pattern, more less resource use, and more easy to control.
- split some module, easy to use with maven.
- two queue type, JAVA raw BlockingQueue and redis list.
- some common use implements, e.g. Dir file and FTP file.
- open for extension. user can easy implement themself's need.
How to use
Project is not registe in maven repository. So if you want to use in your project, you need install in you local repository.
git clone https://github.com/playaround88/scan
cd scan
mvn clean install -Dmaven.test.skip=true -s ${Your maven settings file}
And in your project, just easily copy below dependency.
IF you just use JAVA raw BlockingQueue
<dependency>
<groupId>com.ai</groupId>
<artifactId>scan-core</artifactId>
<version>${release.version}</version>
</dependency>*All other module depend on scan-core module.
IF you want use redis as Queue
<dependency>
<groupId>com.ai</groupId>
<artifactId>scan-redis</artifactId>
<version>${release.version}</version>
</dependency>If you want use directory file scan feature
<dependency>
<groupId>com.ai</groupId>
<artifactId>scan-file</artifactId>
<version>${release.version}</version>
</dependency>If you want use directory file scan feature, and use redis as queue.
<dependency>
<groupId>com.ai</groupId>
<artifactId>scan-redis</artifactId>
<version>${release.version}</version>
</dependency>
<dependency>
<groupId>com.ai</groupId>
<artifactId>scan-file</artifactId>
<version>${release.version}</version>
</dependency>*FTP scan is like directory file scan.