abawchen/sugar-apple

Sugar-Apple

這是一個從政府資料開放平臺抓取不動產買賣實價登錄批次資料的專案，可將下載資料轉檔進資料庫。將持續開發以下功能：

• Backend
  • Data query api by graphQL
  • Integration with more meta / real estate data
    • Crawler task (refer to crawler)
    • Data integration
  • Find out the bargaining space
• Frontend(Web)
  • Friendly ui query
  • Data visualization

---

apple (backend)

On the terminal, create a new virtual python environment by virtualenvwrapper, or refer cheatsheet for more detail:

$ mkvirtualenv --python=$(which python3.5) venv

With the virtual environment activated, install related packages:

$ cd apple
$ pip install -r requirements.txt

Create apple/app/instance/config.py, and you can use either mysql or mongo whatever you like: For mysql, by setting SQLALCHEMY_DATABASE_URI:

SQLALCHEMY_DATABASE_URI = 'mysql+mysqldb://root:password@127.0.0.1:3306/sugar-apple'

For mongo, by setting MONGO_DATABASE_URI:

MONGO_DATABASE_URI = 'mongodb://localhost:27017'

Install the interactive sugar-apple backend cli:

$ cd apple && pip install --editable .

Use cli to persist data to database:

$ sugar-apple
Version: 0.0.1
Syntax: apple <command> [params] [options]
apple> apple download
apple> apple unzip
apple> apple transcode
apple> apple normalize
apple> apple persist -d mysql # for mysql
apple> apple persist -d mongo # for mongo
apple> exit

Start flask server:

$ export FLASK_APP=app/app.py && flask run -p 5001

Then you can visit http://127.0.0.1:5001/graphql-mysql with mysql, or http://127.0.0.1:5001/graphql-mongo with mongo.

---

sugar (frontend)

Install dependencies:

$ cd sugar
$ yarn

Configure Webpack:

# for development
$ cp webpack.config.example.js webpack.config.dev.js

# for production
$ cp webpack.config.example.js webpack.config.prod.js

Output bundle:

# for development
$ yarn run build:dev

# for production
$ yarn run build

Start dev server:

$ yarn start

Now the client app is running at http://{webpackDevServerHost}:{webpackdevServerPort}

---

Happy Coding!