It can only return 30 links using Rcrawler()
shangyuan232 opened this issue · 0 comments
shangyuan232 commented
Hi, I tried the following codes, which only returns 30 links.
Rcrawler(Website = "https://japantoday.com/search?keyword=election", no_cores = 2, no_conn = 2, ExtractXpathPat = ".//h3[@class='media-heading text-xstrong']/a/@href", ManyPerPattern = TRUE, MaxDepth = 1)
I even changed 'no_cores = 1, no_conn = 1.', the results are the same.
If I open https://japantoday.com/search?keyword=election and click "next", I can find more than 100 results.
Could you please help me solve this problem?
Thanks!!