Transwarp Sample Code
This repository contains the example projects for componetnts on Transwarp Data Hub.
-
Transwarp's Distribution for Apache Hadoop for Enterprise has a five-layer architecture. Different applications provide customized support via flexible combination and efficient coordination among components.
-
Transwarp Inceptor in-memory analysis engine provides high-speed interactive SQL queries.
-
Transwarp Hyperbase real-time data processing engine, based on Apache HBase, is optimal for highly concurrent online business systems for enterprises.
-
Transwarp Stream real-time streaming processing engine, based on Apache Spark, possesses powerful stream processing abilities.
-
Transwarp Discover machine learning engine provides data mining via R.
Project List
You can read the user-guide.txt for how to use the projects with a quick view.
BatchInsert. Example for batch insert data by Inceptor JDBC.
- Kerberos Support
ComplexSearch. Example for fulltext search by Inceptor JDBC (index builded by Elasticsearch).
- Kerberos Support
Elasticsearch. Example for usage of Elasticsearch Java API.
- Kerberos Support
FlumeInterceptor. Example for Flume Interceptor, contanins row and column (regex) filter.
- Kerberos Support
FlumeSink. Example for Flume Sink, synchronising folders and files.
- Kerberos Support
FlumeSource. Example for Flume Source.
- Kerberos Support
Hibernate. Example for Inceptor work with Hibernate 3.X.
- Kerberos Support
Hibernate4. Example for Inceptor work with Hibernate 4.X.
- Kerberos Support
Hibernate5. Example for Inceptor work with Hibernate 5.X.
- Kerberos Support
InceptorJDBC. Example for connect Inceptor via jdbc.
- Kerberos Support
InceptorUDAF. Example for Inceptor UDAF.
- Kerberos Support
InceptorUDF. Example for Inceptor UDF.
- Kerberos Support
InceptorUDTF. Example for Inceptor UDTF.
- Kerberos Support
KafkaConsumer. Example for Kafka Consumer with multi-threading.
- Kerberos Support
KafkaDecoder. Example for Kafka Decoder.
- Kerberos Support
KafkaPartitioner. Example for Kafka Partitioner.
- Kerberos Support
KafkaProducer. Example for Kafka Producer with multi-threading.
- Kerberos Support
KeywordSearch. Example for keyword search by Inceptor JDBC (index builded by Elasticsearch), and contains PDF/PPT/Word/Excel to txt convert function.
- Kerberos Support
MultiLocalMode. Example for multi-threading query with Hyperbase external table by Inceptor JDBC.
- Kerberos Support
ObjectStore. Example for storing non-text (such as image, video, etc) files in Hyperbase or HDFS with with multi-threading.
- Kerberos Support
StreamDataCheck. Example for black-list filter with StreamSQL UDF/UDTF.
- Kerberos Support
WebHDFS. Example for Web HDFS Java API.
- Kerberos Support
iBatis. Example for Inceptor work with iBatis.
- Kerberos Support
rJava. Example for Spark Scala API.
- Kerberos Support
Building and Running
To build the code, you will first need to have installed Maven and Java. Then import projects to your favourite IDE (If you use IntelliJ, every project isn't a IntelliJ Maven project's module, the whole project isn't IntelliJ project either. So you need import every project as existing module to your IntelliJ one by one).
The Transwarp Data Hub Maven repository, you can download here.
Support
- You can post bug reports and feature requests at the Issue Page