stanford-scene-database: A C repository from jpapon

---- Stanford Scene Database

This project provides a barebones interface that demonstrates how to parse scene and model files in our scene database.
Our focus is on interior scenes so our database does not contain outdoor environments.
Most scenes are rooms one might expect to find in a house or office building.

Although we experimented with using scenes users have uploaded to Google 3D Warehouse, we concluded it was not fruitful to pursue this because the segmentation quality, tagging quality, and model density of scenes on Google Warehouse are extremely poor.
Instead we build a model database using Google 3D Warehouse and have users model new scenes using our own interior modeling program:
http://graphics.stanford.edu/projects/SceneStudio/
This program uses Google's well-tagged model database to generate scenes with very good segmentations and a well-tiered scene graph.
Feel free to model new scenes and upload them to the database.
At the moment our modeling program is Windows only, although the code in this project is cross-platform.

Our collection of scenes is useful for understanding the relationships between objects and related avenues of research that focus on understanding a collection of objects as a whole in addition to properties of isolated objects.
We converted the model database and scene description files into easily parsed ASCII formats in an attempt to make it easy for other researchers to use our database in their own work.

**** 1. Database Construction

Below is a list of steps describing the process we used to build our model and scene database.

1. Construct an approximate list of tags commonly found in interior environments.
2. Use Google 3D Warehouse's search engine to acquire SketchUp files for the first 20 pages of results for each tag.
3. Acquire a name and set of tags for each model from its HTML page.
4. Go through each SketchUp model, and manually select all the "isolated objects".
5. Use SketchUp to convert all the selected models to COLLADA (we then further convert them into Wavefront .obj files and a binary format used by our modeling program).
6. Have many people use this model database to create interior scenes using our modeling program, recording all their text search queries.
7. Use these search queries to construct a new list of tags, and repeat steps 2-6 several times, until we have most of the relevant models on Google 3D Warehouse and many scenes containing them.

Here "isolated object" is used to reject models with undesireable properties such as the following:
- Multiple objects: ex. http://sketchup.google.com/3dwarehouse/details?mid=ea7182868569cafa4e6c6248f210bd8b
- Supporting geometry: ex. http://sketchup.google.com/3dwarehouse/details?mid=c8a32ee82a91795511fc2b865c2a185b
We sometimes accepted models that contained multiple objects, if the collection is also meaningful. Examples include:
- Fruit bowl: http://sketchup.google.com/3dwarehouse/details?mid=c5a2f2b387962f95efa86b03d795ce7f
- Rows of books: http://sketchup.google.com/3dwarehouse/details?mid=45e888388c36cace7c6ab6f4a65805ac

All files on Google 3D Warehouse are referenced using a unique model ID that is a hash of the model's SketchUp file and the user who uploaded it.
Our database continues to use these model IDs to reference models, so it is easy to recover information about a particular model from Google Warehouse.

**** 2. Database Files

There are four folders in the database:
- models: Contains Wavefront .obj files for all models, along with corresponding .mtl files.
- textures: JPEG textures used by the .obj files.
- scenes: Contains scene file descriptions for all files in the database.
Scenes come in two format, *.scs, which is used by SceneStudio, and *.txt, which is a simpler file format used by the code in this project.
See SceneFileFormat.txt for a description of the format.
- fields: A list of the name and tags for each model, indexed by Google model ID.

We provide three different databases: <THIS IS OUT OF DATE>
"databaseSample" contains a single scene and is meant for testing purposes (~11MB). This is part of the svn checkout.
"databaseObserved" contains all scenes users have modeled, but only those models in the database that occur in at least one scene (~3GB uncompressed, 500MB compressed). You can download this here:
http://graphics.stanford.edu/projects/SceneStudio/databaseObserved.zip
"databaseFull" contains all scenes users have modeled, and all models in the model database (~20GB, uncompressed).

Here is an approximate size estimate for the database (this may be out of date):
28,985 models downloaded from Google Warehouse
11,165 models marked as "isolated objects"
139 scenes
3728 objects instances
1606 unique object instances

**** 3. Code Structure

This code uses GLUT and is setup to compile with Visual Studio and g++.
The project uses freeimage to read JPEG images. We have included a precompiled version of GLUT and freeimage for Visual Studio.
There are two projects: modelViewer and sceneViewer.
A Visual Studio solution is provided in the windows/vs2010 subdirectory. Directories named "Default" in the root, in sceneViewer and in modelViewer contain makefiles and Eclipse+CDT project files for shared library code, sceneViewer and modelViewer code correspondingly. The "makeAll" script compiles the shared code into a library installed at "/usr/local/lib/libstanford-scene-database.so" and then creates the sceneViewer and modelViewer binaries in the bin directory.
Let us know if you encounter any trouble compiling the code on Linux or Windows.
These projects can be configured by modifying bin/parameters.txt.
Changing databaseDirectory can be used to switch between the "sample", "observed", and "full" databases.

sceneViewer -- this project reads the scene file specified by the "defaultScene" parameter.
It loads all the models in this scene and renders them using the transform specified in the scene file.

modelViewer -- this project can be used to browse the model database.
It loads all the model names and tags from the <database>/fields directory.
These models are sorted according to the "textQuery" parameter.
Use "textQuery=@" to specify a random order.
The left and right arrow keys browse through the list of results.

jpapon/stanford-scene-database