Preparing the Tasking Manager project

Question

Preparing the Tasking Manager project

Closed this issue 9 years ago · 13 comments

The initial plan is to manage this import using the Tasking Manager. Ideally, using the osm.us instance.

We started developing the feature of being able to download the data in the TM. See this demo.

To be able to run this in osm.us instance, we need to merge this feature in TM's main code. As per conversation with my colleagues (@batpad and @geohacker), this may not be possible if we want to get this rolling ASAP for two reasons:

this feature is not a common use case for the TM and may not be merged to master,
even if the community sees this as a good feature to implement, there is technical lift to prepare a PR and may delay our implementation.

Given the above scenario. I see two options:

Deploy a separate TM instance with the download data feature just for this import.
We can maintain this instance during the import process and for a limited time after the import.
I made a sample running TM project here: http://52.74.49.58:6543/project/15
Use the osm.us instance without this feature. We can prepare a document like a spreadsheet or wiki where importers can download the data in their respective task. This adds an overhead for those participating in the import, but I don't think its too much of hassle provided we give clear instructions in the import guidelines.

Lets use this ticket to discuss the pros/cons of the outlined options or, if there are other ways.

@almccon @jschleuss @cityhubla @planemad

Answer 1 · 2016-02-26T09:54:40.000Z

I prepared filtered blockgroups here: https://github.com/osmlab/labuildings/tree/master/task_blocks

blockgroups_filtered.geojson (6,334 blocks) - full LA county blocks removing Pasadena and all blocks that don't have buildings.
blockgroups_lacity.geojson (2,817 blocks) - LA City only blocks based on the DPW_CITY_BOUNDARIES shapefile.

We agreed to prepare the first import for LA city but loading all of LA city in one TM porject may slowdown the TM site.

I propose we split LA City into several projects. For example: downtown LA, north section, south section.

Other ideas?

Answer 2 · 2016-02-27T04:03:18.000Z

Or maybe split into four: north section (The Valley), Westside, Eastside (central section including DTLA), and south section.

I suggest this mainly because Westside/Eastside is a common psychogeographic concept for most Angelenos.

Answer 3 · 2016-02-29T08:55:48.000Z

@almccon, I found this resource from LA Times it draws boundaries of 16 neighborhoods for the whole LA County. Should we use this?

Answer 4 · 2016-02-29T10:37:44.000Z

@maning ^ that looks like a great reference, we should go with this.

Answer 5 · 2016-02-29T12:09:57.000Z

@planemad, generated geojsons.

Answer 6 · 2016-02-29T18:38:07.000Z

@maning looks great. Those regions don't line up with the LA City boundary, so are you thinking that we intersect those regions with the LA City boundary to get our first set of projects?

Answer 7 · 2016-03-01T09:42:25.000Z

For LA City only, here's the block groupings:

Eastside (1,322 blocks) - Eastside including greater downtown LA.
Southside (207 blocks) - South bay and harbor.
Valley (897 blocks) - San Fernando Valley and Northwest county.
Westside (391 blocks) - Westside and Santa Monica.

Note that there are holes because according to LA County city boundaries, they are not part of LA City such as Beverly Hills and San Fernando City.

@almccon

Answer 8 · 2016-03-02T01:56:30.000Z

Nice!
Is the Eastside group small enough (with 1,322 blocks)? We could subdivide it further if necessary. Or maybe move the blocks that are in the South LA subregion from our Eastside into our Southside.

Answer 9 · 2016-03-02T05:54:44.000Z

Can the groups be tasked? I'm wondering if the Southside can be our test for JOSM training and the Eastside for the mapathon. Are the blocks outside of LA City being included? The black dotted line on this image shows the boundaries for LA City.

Answer 10 · 2016-03-02T07:32:59.000Z

@almccon Moved blocks from eastside to southside. All groupings are now under 1k.

@cityhubla,

Can the groups be tasked?

Yes, I'm just waiting for @iandees to migrate the current osm.us TM instance to have this download import data feature. We are preparing a backup instance in case osm.us is not ready for the training and mapathon.

Are the blocks outside of LA City being included? The black dotted line on this image shows the boundaries for LA City.

Not yet, we focus on LA City for initial import stage.

Answer 11 · 2016-03-02T12:54:21.000Z

As far as I know the feature to load OSM data into the task via the geojson has not been merged into the tasking manager repo. I don't feel comfortable maintaining a fork that hacks the feature in and am waiting for it to be merged before doing anything to tasks.openstreetmap.us.

Answer 12 · 2016-03-02T13:06:05.000Z

@maning the new groupings look great to me!

@cityhubla,

I'm wondering if the Southside can be our test for JOSM training and the Eastside for the mapathon.

We could do this, or we could use the same grouping for both... since we don't know yet how long this will take, maybe we just try to funnel all the attention into just one of the groupings until it's mostly finished? I could go either way.

Answer 13 · 2016-03-30T13:34:16.000Z

Tasking Manager better slightly better URL: http://labuildingsimport.com/
Ideally we want it in the US TM instance, but the enhancement PR is not yet merged. I agree with @iandees on not merging this feature to US TM unless its in master. But since we have a mapathon this week, we wnet ahead to deploy a custom instance.

Let's discuss later how long we want to maintain this after the import.