JLucky

I am JLucky，I am a student. I love large-scale data processing and analysis.

Pinned Repositories

2014
2014要做的一些事的记录
Language:C++0 2 00
acm-cheat-sheet
Acm Cheat Sheet
Language:TeX0 2 00
AlphaGo
A replication of DeepMind's 2016 Nature publication, "Mastering the game of Go with deep neural networks and tree search," details of which can be found on their website.
Language:JavaScript0 2 00
ansj_seg
ansj分词.ict的真正java实现.分词效果速度都超过开源版的ict. 中文分词,人名识别,词性标注,用户自定义词典
Language:Java0 2 00
Availability-Monitor-for-Kafka
A tool to monitor Kafka availability and latency and report these metrics to SQL Server, JMX, CSV, SLF4J endpoints.
Language:Java0 2 00
avbook
Illegal vehicle from Red Castle
Language:PHP0 2 00
Bookshelf
A reading list management
Language:Python0 2 00
bootcamp
Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc.
Language:Python0 0 00
clover
clover 1、开发server和client端定时向zk集群发送心跳数据包，利用Java自带的timer程序实现该功能 2、开发整天的monitor程序，用来定时向zk中获取server和client端的心跳数据信息，如果超过指定时间没有收到最新的数据包，那么任务server端或者client端死掉了，此时要删除该server或client端节点，发邮件通知相关人员，记录异常日志到系统日志文件和MongoDB中 3、client端接受创建job请求，将job信息创建到client服务端，并根据job时间规则运行，并将任务信息存储到MongoDB中 4、当client端job运行时候，封装执行任务信息,发送到指定客户端机器，更新client端job执行时间和状态，如不在需要继续运行，那删除job并从MongoDB中删除相关任务信息 5、client端接受删除job请求，client服务端，立即执行删除job并将任务信息从MongoDB中删除 6、client端接受更新job请求，client服务端，立即执行删除job并创建新job,并将任务信息从MongoDB中删除,然后再存储新job信息 7、第一版使用Netty做消息通讯中间件，存储消息放入Redis中，服务器开启Http请求，客户端通过发送Http请求到服务器来处理请求，由于任务太多 redis处理能力不行，放弃该方案第二版使用Netty RPC框架，自己开发一个Server端和Client，各种启动指定端口，由于必须要求Server端和Client必须启动才能进行消息发送，所以感觉非常不灵活，因为放弃该方案第三版使用架构组推荐的rocketmq,通过使用发现，很严重问题，消息会重复发送，经常会收到重复的消息，在测试的时候发现，经常发生消息异常和报错，跟架构组刘婷峰沟通说，可能是机器性能不行了，他也不知道具体原因，感觉非常不靠谱，果断放弃第四版使用 zeromq,通过在网上查资料，对比各种mq后，发现zeromq是最轻量级，出现消息是最快的，经过测试完全能满足业务，果断使用 8、由于项目中使用zk,自己开发zk使用工具类，定制server端增删改查zk消息以及定制client端增删改查zk消息,功能测试zk,目前打算增加zk watch功能 9、开发server和client端定时向zk集群发送心跳数据包，利用Java自带的timer程序实现该功能 10、开发整天的monitor程序，用来定时向zk中获取server和client端的心跳数据信息，如果超过指定时间没有收到最新的数据包，那么任务server端或者client端死掉了，此时要删除该server或client端节点，发邮件通知相关人员，记录异常日志到系统日志文件和MongoDB中 11、开发console控制台管理，可以查看任务动态运行状态和次数信息 12、zk管理页面，查看server和client端节点信息，更新和删除节点信息 13、job管理页面，查看job详细信息 14、联系人管理页面，增删改查联系人信息 15、log日志管理页面，根据系统报错记录的日志信息，在页面中可以详细查看
Language:Java0 2 00
Pillow
The friendly PIL fork
Language:Python1 1 00

JLucky's Repositories

JLucky/AlphaGo
A replication of DeepMind's 2016 Nature publication, "Mastering the game of Go with deep neural networks and tree search," details of which can be found on their website.
Language:JavaScript0 2 00
JLucky/Availability-Monitor-for-Kafka
A tool to monitor Kafka availability and latency and report these metrics to SQL Server, JMX, CSV, SLF4J endpoints.
Language:Java0 2 00
JLucky/avbook
Illegal vehicle from Red Castle
Language:PHP0 2 00
JLucky/bootcamp
Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc.
Language:Python0 0 00
JLucky/CoolplaySpark
酷玩 Spark: Spark 源代码解析、Spark 类库等
Language:Scala2 0
JLucky/data-transform
Language:JavaScript
JLucky/davinci
Language:JavaScript2 0
JLucky/JD_Sign_Action
基于github actions的京东自动化签到
JLucky/jlucky.github.com
Language:CSS2 0
JLucky/kafka-monitor
Monitor the availability of Kakfa clusters with generated messages.
Language:Java2 0
JLucky/KafkaOffsetMonitor
A little app to monitor the progress of kafka consumers and their lag wrt the queue.
Language:Scala2 0
JLucky/kraps-rpc
A RPC framework leveraging Spark RPC module
Language:Scala2 0
JLucky/light-task-scheduler
Distributed Scheduled Job Framework
Language:Java2 0
JLucky/mastering-apache-spark-book
Mastering Apache Spark 2
2 0
JLucky/milvus
An open-source vector database for embedding similarity search and AI applications.
Language:Go0 0
JLucky/Python
All Algorithms implemented in Python
Language:Python0 0
JLucky/rime-pinyin-simp
【袖珍簡化字拼音】輸入方案
0 0
JLucky/scikit-learn-doc-zh
scikit-learn（sklearn）官方文档中文版
2 0
JLucky/scrapy-examples
Multifarious Scrapy examples.
Language:Python2 0
JLucky/spark
Mirror of Apache Spark
Language:Scala2 0
JLucky/spark-ml-source-analysis
spark ml 算法原理剖析以及具体的源码实现分析
2 0
JLucky/spark-submit-ui
This is a based on playframwork for submit spark app
Language:CSS2 0
JLucky/spark-summit-2017-Europe
Spark summit 2017 europe ppt下载
2 0
JLucky/Stirling-PDF
locally hosted web application that allows you to perform various operations on PDF files
JLucky/SuperWeChatPC
超级微信电脑客户端，支持多开、防消息撤销、语音消息备份...开放WeChatSDK
Language:C++1 0
JLucky/TensorFlowOnSpark
TensorFlowOnSpark brings TensorFlow programs onto Apache Spark clusters
Language:Python2 0
JLucky/wereader
一个浏览器扩展：主要用于微信读书做笔记，对常使用 Markdown 做笔记的读者比较有帮助。
Language:TypeScript0 0
JLucky/wooyun_public
乌云公开漏洞、知识库爬虫和搜索 crawl and search for wooyun.org public bug(vulnerability) and drops
Language:Python2 0
JLucky/wormhole
Language:JavaScript2 0
JLucky/zeus2
work flow schedule
Language:Java2 0