/socialite

SociaLite: query language for large-scale graph analysis and data mining

Primary LanguagePythonOtherNOASSERTION

SociaLite: Python-integrated Query Language For Big Data Analysis

http://socialite.stanford.edu

SociaLite is a high-level query language for distributed data analysis. In SociaLite, analysis programs are implemented in high-level queries, that are compiled to parallel/distributed code. The compiled code is highly optimized, and can run as fast as three orders of magnitude (1000x) faster than equivalent Hadoop programs on InfiniBand network.

SociaLite is Hadoop compatible, hence SociaLite queries can read data on HDFS (Hadoop Distributed File System). With its Java and Python extension, SociaLite queries can read data from other input sources such as Amazon S3 or relational databases.

Its integration with Python makes it convenient to implement data analysis algorithms in SociaLite. Many well-known analysis algorithms such as PageRank, K-Means clustering, or Logistic Regression can be implemented in just a few lines of SociaLite queries and a couple of Python functions.

Interested? Read the quick tutorial