Tjcug
SC'21 & ICDE'23 CCF-A computer conference paper author, focusing on big data, streaming systems.
AntGroupHangzhou, China
Pinned Repositories
Ares
Ares, a high performance and fault tolerant DSPS. Ares considers both system performance and fault tolerant capability during task allocation. In the design of Ares, we formalize the problem of Fault Tolerant Scheduler (FTS) for finding an optimal task allocation which maximizes the system utility. We treat the FTS problem as a game and propose Nirvana, an algorithm based on best-response dynamics scheduling strategy.
auth
这是从慕课网中学习的Java权限管理系统
BigDataAnalysisWeb
Big data performance test analysis platform (including WebUI display)。 BigDataAnalysisWeb Analyze storm, spark, and flink throughput changes in the form of charts.
busstation
公交线路GIS系统，包括公交换乘算法（最短路径算法）
DStream
DStream is a popularity-aware differentiated distributed stream processing system, which identifies the popularity of keys in the stream data and uses a differentiated partitioning scheme. DStream greatly outperforms Storm on skew distributed data in terms of throughput and processing latency.
HdfsCachePool
Hadoop Distributed File System (HDFS) has slow serial read speed of the log stream file, it cannot meet the requirements of the stream processing system and can not fully exert the processing capability of the stream processing system, thus restricting the stream processing system. Improve performance. On the basis of HDFS, this software adopts parallel data transmission methods to fully utilize network bandwidth and effectively improve the throughput of distributed file system and meet the demand of stream processing system for data source throughput. At the same time, with respect to the highly ordered nature of the log stream, the software controls the timing of the data to ensure the timing of the log file and provides high-speed and orderly data input for the stream processing system.
jucAction
Java JUC 学习项目 包括各种并发多线程的高级使用。java自带多线程并发锁高级应用
RdmaChannel
RDMA Channel: A Channel-Oriented RDMA Java Communication Library. More high-level abstract Channel API on top of RDMA verbs.
RDMAFileTransfer
RDMA Large File Transfer：A Large-scale File and Folder Transfer Framework. By using two components, RDMA Channel and RDMA Verbs.
Whale
Whale is a novel RDMA-assisted DSPS with efficient one-to-many data partitioning. Whale explores a novel RDMA-assisted stream multicast mechanism and a new worker-oriented communication mechanism. We implement Whale on top of Apache Storm and evaluate it using experiments with large-scale datasets. The results show that Whale achieves 56.6x improvement of system throughput and 97% reduction of processing latency compared to existing designs.
Tjcug's Repositories
Tjcug/BigDataAnalysisWeb
Big data performance test analysis platform (including WebUI display)。 BigDataAnalysisWeb Analyze storm, spark, and flink throughput changes in the form of charts.
Tjcug/RDMAFileTransfer
RDMA Large File Transfer：A Large-scale File and Folder Transfer Framework. By using two components, RDMA Channel and RDMA Verbs.
Tjcug/HdfsCachePool
Hadoop Distributed File System (HDFS) has slow serial read speed of the log stream file, it cannot meet the requirements of the stream processing system and can not fully exert the processing capability of the stream processing system, thus restricting the stream processing system. Improve performance. On the basis of HDFS, this software adopts parallel data transmission methods to fully utilize network bandwidth and effectively improve the throughput of distributed file system and meet the demand of stream processing system for data source throughput. At the same time, with respect to the highly ordered nature of the log stream, the software controls the timing of the data to ensure the timing of the log file and provides high-speed and orderly data input for the stream processing system.
Tjcug/kafkaParallelIO
Java NIO java TransferTo方法优化：并行读取磁盘IO。Kafka并行传输直接内存池，利用DirectMemoryChannel并行或者串行的读取数据。
Tjcug/RdmaChannel
RDMA Channel: A Channel-Oriented RDMA Java Communication Library. More high-level abstract Channel API on top of RDMA verbs.
Tjcug/Ares
Ares, a high performance and fault tolerant DSPS. Ares considers both system performance and fault tolerant capability during task allocation. In the design of Ares, we formalize the problem of Fault Tolerant Scheduler (FTS) for finding an optimal task allocation which maximizes the system utility. We treat the FTS problem as a game and propose Nirvana, an algorithm based on best-response dynamics scheduling strategy.
Tjcug/RDMABenchMark
RDMA BenchMark 包括带宽和延迟测试 与传统网络相比较
Tjcug/DStream
DStream is a popularity-aware differentiated distributed stream processing system, which identifies the popularity of keys in the stream data and uses a differentiated partitioning scheme. DStream greatly outperforms Storm on skew distributed data in terms of throughput and processing latency.
Tjcug/JavaConcurrentCode
Java 并发编程的艺术 源码。深入理解Java并发编程
Tjcug/JavaDesignPattern
Java 设计模式 包括单例模式、模板方法模式、工厂模式、责任链模式、策略模式、代理模式、观察者模式和适配器模式。
Tjcug/JbexGis
基于MapGis开发的“感知校园”的社交应用是利用 Gis 技术实现的 移动端应用和利用JavaWeb技术实现的Web端后台管理应用。
Tjcug/Algorithm
算法分析：提升算法能力（动态规划、递归等）
Tjcug/hadoopAction
hadoop 深入学习 HDFS-API以及MapReduce相关操作，同步Bolg更新
Tjcug/JavaBasciLearing
Java基础知识学习：包括JVM虚拟机、对象模型等Java基础知识代码案例。（此项目与本人的博客用到的代码同步更新）
Tjcug/JavaCommunicate
Java通信协议Study 包括Scoket通信、NIO通信、Netty通信
Tjcug/jverbs-demo
A simple client/server demo using jVerbs.
Tjcug/ThinkInJavaLearning
Thinking in java 4th code(java编程**第四版源代码) Java基础知识
Tjcug/Whale
Whale is a novel RDMA-assisted DSPS with efficient one-to-many data partitioning. Whale explores a novel RDMA-assisted stream multicast mechanism and a new worker-oriented communication mechanism. We implement Whale on top of Apache Storm and evaluate it using experiments with large-scale datasets. The results show that Whale achieves 56.6x improvement of system throughput and 97% reduction of processing latency compared to existing designs.
Tjcug/zookeeperAction
Apache Zookeeper是一个分布式协调服务，就是为用户的分布式应用程序提供协调服务.本项目Apache Zookeeper的学习项目。ZookeerperAction Zookeeper简单实现RMI高可用性 包括RIM服务。并且包括用Zookeeper实现分布式锁以及分布式系统动态上线下线。
Tjcug/BDPSWorkShop
BigData Processing Systems 2018 BDPS WorkShop 主页
Tjcug/blog
GitHub Master.TJ 我的个人博客主页
Tjcug/CS-Notes
:books: Computer Science Learning Notes
Tjcug/DataStructure
数据结构与算法分析 书籍源码实现
Tjcug/DockerAction
DockerAction Docker使用包括DockerFile的使用 以及Docker容器和镜像的创建
Tjcug/ICNPWorkShop
Networking BigData 2017 ICNP WorkShop主页
Tjcug/mydotfiles
All of my dot configuration files.
Tjcug/note
学习笔记整理📚
Tjcug/spark-parent
Apache Spark核心源码分析：Spark Core、Spark Streaming源码分析(内容有spark消息通信原理、spark作业执行原理、spark调度算法原理等等)
Tjcug/SpringAction
Spring框架 深入理解Spring框架：包括Spring IOC、Spring AOP、Spring面向切面的编程等
Tjcug/SpringCloudAction
SpringCloud微服务学习：包括Springboot、springConfig、SpringRibbon等等。（此项目与本人的博客用到的代码同步更新）