JujaLabs/itevents

Create brief description of crawler module

Closed this issue · 6 comments

Add brief description below technical decisions in Обсуждение архитектуры краулера.
Add 1-2 schema of modules relation, describe each module. Should be sound like next
_Module should be Java application with main method run by cron. Contains at least 2 modules - Engine, Integration.
Responsibilities:
Engine:

  • run integrations, process event with business logic rules.
  • process geo coordinates
  • etc.

Integration:

  • grab event from eternal source
  • generate unique id
    -etc._

Don't forget to mention DAO from ITevents.
This will be technical decision enough to start development.

UPD: also, list main technologies and frameworks

@vaa25 it will be better to add actual links of documents to the first comment
For example:

Additional links:

vaa25 commented

@romach it is the same document

@vaa25 yes I was wrong.
But it is better to give descriptive titles to the links (Discussion of crowler architecture) and these titles should be the same in all comments.

vaa25 commented

@romach Purpose of that comment was calling of vkuchin, not link to doc.