LuciferYang

Apache Spark Committer / Apache incubator-uniffle PPMC

@baiduBeijing

Pinned Repositories

Ammonite
Scala Scripting
Language:Scala0 0 00
arrow
Mirror of Apache Arrow
Language:C++0 2 00
arrow-datafusion-comet
Apache Arrow DataFusion Comet Spark Accelerator
Language:Rust0 0 00
atlasdb
Transactional Distributed Database Layer
Language:Java0 2 00
Awesome-Chinese-LLM
整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。
0 0 00
bigflow
Language:C++0 2 00
brpc
Most common RPC framework used throughout Baidu, with 600,000+ instances and 500+ kinds of services, called "baidu-rpc" inside Baidu.
Language:C++0 2 00
brpc-java
Java implementation for Baidu RPC, multi-protocol & high performance RPC.
Language:Java0 1 00
git
1 1 00
spark
Mirror of Apache Spark
Language:Scala1 3 04

LuciferYang's Repositories

LuciferYang/spark
Mirror of Apache Spark
Language:Scala1 3 04
LuciferYang/arrow
Mirror of Apache Arrow
Language:C++0 2 00
LuciferYang/arrow-datafusion-comet
Apache Arrow DataFusion Comet Spark Accelerator
Language:Rust0 0 00
LuciferYang/chill
Scala extensions for the Kryo serialization library
Language:Scala0 0
LuciferYang/delta
An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.
Language:Scala1 0
LuciferYang/elasticsearch-hadoop
:elephant: Elasticsearch real-time search and analytics natively integrated with Hadoop
LuciferYang/gluten
Language:Scala1 0
LuciferYang/gravitino
A high-performance, geo-distributed and federated metadata lake
Language:Java0 0
LuciferYang/hudi
Upserts, Deletes And Incremental Processing on Big Data.
Language:Java0 0
LuciferYang/iceberg
Apache Iceberg
Language:Java0 0
LuciferYang/incubator-paimon
Apache Paimon(incubating) is a streaming data lake platform that supports high-speed data ingestion, change data tracking and efficient real-time analytics.
LuciferYang/incubator-uniffle
Uniffle is a high performance, general purpose Remote Shuffle Service.
Language:Java1 0
LuciferYang/kryo
Java serialization and cloning: fast, efficient, automatic
Language:HTML2 0
LuciferYang/kubernetes-client
Java client for Kubernetes & OpenShift
LuciferYang/lancedb
Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!
LuciferYang/llama
Inference code for LLaMA models
Language:Python0 0
LuciferYang/llama_index
LlamaIndex is a data framework for your LLM applications
LuciferYang/logging-log4j2
Apache Log4j 2 is a versatile, feature-rich, efficient logging API and backend for Java.
Language:Java1 0
LuciferYang/Megatron-LM
Ongoing research training transformer models at scale
LuciferYang/metrics
:chart_with_upwards_trend: Capturing JVM- and application-level metrics. So you know what's going on.
LuciferYang/nimble
New file format for storage of large columnar datasets.
LuciferYang/onetable
OneTable is an omni-directional converter for table formats that facilitates interoperability across data processing systems and query engines.
Language:Java0 0
LuciferYang/petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Language:Python0 0
LuciferYang/pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration
LuciferYang/simdjson-java
A Java version of simdjson
LuciferYang/spark-docker
Official Dockerfile for Apache Spark
Language:Shell1 0
LuciferYang/spark-kubernetes-operator
Apache Spark Kubernetes Operator
LuciferYang/sparklyr
R interface for Apache Spark
LuciferYang/substrait
A cross platform way to express data transformation, relational algebra, standardized record expression and plans.
Language:Python0 0
LuciferYang/unitycatalog
Open, Multi-modal Catalog for Data & AI
Language:Java