/deepsketch2face

Demo and Database of "DeepSketch2Face" (SIGGRAPH 2017)

Apache License 2.0Apache-2.0

DeepSketch2Face

Note: The database and the full progame code are not publicly available at the moment under patent protection and other authors' interest.

Demo of DeepSketch2Face: A Deep Learning Based Sketching System for 3D Face and Caricature Modeling. Logo We use Caffe modified from Microsoft/Caffe. Default Development OS is Windows 10 x64.

Demo (Pure Alexnet Version)

  1. Download repo here
  2. Download caffemodel and dlls and expand to $(this_repo)\demo
  3. Install CUDA v8.0 (into C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v8.0). Other versions may not be supported.
  4. Run $(this_repo)\demo\deepsketch2face.exe

Demo (With bilinear encoding)

Not available

Database

Please contact hanxiaoguang@cuhk.edu.cn for the database.

Source Code Reproduction

May not be uploaded.

  1. Download source repo here
  2. Install Visual Studio 2013 Ultimate
  3. Install CUDA v8.0 (into C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v8.0) and cudnn v5.1 (copy files into C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v8.0\cuda). Other versions may not be supported.
  4. Build $(this_repo)\tools\caffe-master\windows\Caffe.sln in Release x64. If there are errors, check if step 2 is correctly done.
  5. Install Qt 5.8 (VS2013 x64). Other versions may not be supported.
  6. If you use different Qt and Visual Studio version, you need to rebuild $(this_repo)\tools\libQGLViewer\QGLViewer in Qt Creator.
  7. In $(this_repo)\tools\caffe-master\include\caffe\proto\caffe.pb.h, change "STRICT" in line 2525 and 9794 into "_STRICT"
  8. Open $(this_repo)\src\deepsketch2face.pro in Qt Creator, set build directory to $(this_repo)\build, then build the program in Release.
  9. Copy $(this_repo)\build\release\deepsketch2face.exe into $(this_repo)\demo
  10. For all .dll file in $(this_repo)\demo and $(this_repo)\demo\platforms, if you build the program in different settings, you may need to change them correspondingly. A safe but redundant move is to copy all .dll file in $(this_repo)\tools\ and Qt here.
  11. Run $(this_repo)\demo\deepsketch2face.exe