CodeLanka/codeLanka-Proposals

[Proposal] Open Data XLS | PDF to JSON

pasindud opened this issue · 27 comments

Please comment on your thoughts

How about XLS|PDF to JSON. Since SQL itself has lots of limitations now a days specially in mobile and client side of web. I think it'll be great if we can have JSON data as there are ways to convert JSON to SQL if someone wants.
Then even by a simple request you can have the data tunnel to apps that you build.

Hi @dhammika-marasinghe
Yea that is a great idea actually. I shall change the topic.

Change

  • Open Data XLS | PDF to SQL  ->  Open Data XLS | PDF to JSON
    

@dhammika-marasinghe There about 80 data sets suggestion on where to start ?

seems like Central bank, Motor Traffic, ICTA and Police has more useful information for the developers

Can you list down set of data sets ??

I think this is a great idea!
What about starting with datasets under Population: population, literacy rate and colombo consumer price index? I think they would be among the most useful.

Guys are you guys working on this?

hoping to start my work after 2 weeks finishing all these conferences,
projects, exams, ... :p

On Thu, Dec 4, 2014 at 11:59 AM, Pasindu De Silva notifications@github.com
wrote:

Guys are you guys working on this?


Reply to this email directly or view it on GitHub
#2 (comment)
.

Dhammika Marasinghe
Computer Engineering Undergraduate,
Department of Computer Engineering,
University of Peradeniya​

Mobile | +940770776737
LinkedIn | dhammikamarasinghe
http://lk.linkedin.com/in/dhammikamarasinghe/
Facebook | dhammika.marasinghe.net
https://www.facebook.com/dhammika.marasinghe.net
Google+ | DhammikaBandaraMarasinghe
http://google.com/+DhammikaBandaraMarasinghe

I'll be starting after Dec 12th. Got final year project.

bump

Guys made a translisteration singlish api download and have a look https://github.com/CodeLanka/singlish-api

brilliant! i'll check this out as soon as i can. btw, is this the right issue for this comment?

oh it seems not

Check these guys

Annual Population Growth rate

http://codelanka.github.io/open-data-visualization/visualization/annual_population_growth_rate

Dataset to JSON - https://github.com/CodeLanka/open-data-api

*dataset has missing metadata

We can get datasets from Health Ministry also ( Specially about disaster management, etc. ), I can help with that.

Hi.. Since we are still in the very early stages of this, wouldn't it better to plan this project with a focus on where web technologies are headed? My suggestion is to use the linked data approach, using RDF.

Check this: http://www.w3.org/TR/ld-bp/

(I'm also new to these so don't really have much of an idea about the scale of doing such a project though)

@pubudu91 do you know a sample which adheres to this so we can check it?

http://opendatahandbook.org/ something to look into

I would more like to get the data to JSON so later when we have to adhere to standards we can run scripts to transform them.

It would also be useful/interesting to get data-sets from the department of transportation. I haven't been able to find any, but I'll try contacting them (hopefully I won't be turned down).
Also, I'll look into converting the data-sets already provided into JSON.
(Sorry if my comment seems out of place, I'm new here ._. )

has anyone seen this initiative: http://dev.socrata.com/ ?

edit: it's a commercial company, but i think there's something to be learned from their approach

@hliyan That's exactly what I wanted to accomplish.
This is worth a look too. www.youtube.com/watch?v=RrPZza_vZ3w
It's rather long though.

Apologies for my absence. Was overwhelmed with work, so I couldn't really contribute much to the projects recently, but I've been coding a couple of Python scripts that would let me efficiently convert the data-set's from gov.lk to a more computer readable format. I'll keep you updated.