felipecsl/wombat

Is it possible to programmatically create the properties to search for?

Closed this issue · 2 comments

I have a set of sites I index regularly where I store various field definitions alongside xpath parameters.
e.g.

   {"field_name" => "title", "xpath" => "//div[@itemprop=\"title\"]"}
    {"field_name" => "description", "xpath" => "//div[contains(@class,'description')]"}

Is there a way I can use that with the wombat DSL?
Can't work out how to make the field_name display itself in the right way.

I think I've got it.

Assuming an array of those above

Wombat.crawl do 
    base_url @base_url
    field_definitions.each do |fd|
        send(fd["field_name"],xpath:fd["xpath"])
    end
end

If that works for you then you should probably close the issue....