Sheng-J/DOM-Q-NET

Trying to reproduce facebook login

Opened this issue · 0 comments

r4ghu commented

Hi,
I am trying to reproduce facebook login demo by running the hard2medium9tasks and facing the following challenges -

  • Linking the code to live browser instance and sending commands from terminal: I came across demo.py file and it looks like it runs on the miniWob examples. It will be great if you can provide a demo file which can be used to test on any website through command input via terminal.
  • Generalization accuracy for facebook (or other websites) login - I trained the hard2medium9tasks model for 30000 iterations and tried running login user scenario for miniWob websites and the average reward is consistently 1. But when I used this model on facebook webpage (passed the static webpage content through miniwob), the reward is -1. I can see the model able to detect the input fields but not able to paste the right username and password fields. I would like to know if I have to run for 150000 iterations or I can see better results at a lower number of iterations.

Question about PR - It will be great to know if your repository is open for PRs and open-source contributions.