Sinusoidal Representation Networks (SIREN)

Unofficial PyTorch implementation of Sinusodial Representation networks (SIREN) from the paper Implicit Neural Representations with Periodic Activation Functions. This repository is a PyTorch port of this excellent TF 2.0 implementation of the same.

If you are using this codebase in your research, please use the following citation:

@software{aman_dalmia_2020_3902941,
  author       = {Aman Dalmia},
  title        = {dalmia/siren},
  month        = jun,
  year         = 2020,
  publisher    = {Zenodo},
  version      = {v1.1},
  doi          = {10.5281/zenodo.3902941},
  url          = {https://doi.org/10.5281/zenodo.3902941}
}

Setup

Install using pip

$ pip install siren-torch

Usage

Sine activation

You can use the Sine activation as any other activation

from siren import Sine

x = torch.rand(10)
y = Sine(w0=1)(x)

Initialization

The authors in the paper propose a principled way of intializing the layers for the SIREN model. The initialization function can be used as any other initialization present in torch.nn.init.

from siren.init import siren_uniform_

w = torch.empty(3, 5)
siren_uniform_(w, mode='fan_in', c=6)

SIREN model

The SIREN model used in the paper, with sine activation and custom initialization, can directly be created as follows.

from siren import SIREN

# defining the model
layers = [256, 256, 256, 256, 256]
in_features = 2
out_features = 3
initializer = 'siren'
w0 = 1.0
w0_initial = 30.0
c = 6
model = SIREN(
    layers, in_features, out_features, w0, w0_initial,
    initializer=initializer, c=c)

# defining the input
x = torch.rand(10, 2)

# forward pass
y = model(x)

Results on Image Inpainting task

A partial implementation of the image inpainting task is available as the train_inpainting_siren.py and eval_inpainting_siren.py scripts.

To run training:

$ python scripts/train_inpainting_siren.py

To run evaluation:

$ python scripts/eval_inpainting_siren.py

Weight files are made available in the repository under the checkpoints directory. It generates the following output after 5000 epochs of training with batch size 8192 while using only 10% of the available pixels in the image during training phase.

Tests

Tests are written using unittest. You can run any script under the tests folder.

Contributing

As mentioned at the beginning, this codebase is a PyTorch port of this. So, I might have missed a few details mentioned in the original paper. Assuming that the implemention in the linked repo is correct, one can safely trust this implementation as well. The only major difference from the reference repo is that it has w0 as part of the initialization as well. I did not see that in the paper and hence, didn't include it here. I have not deeply read the paper and this is simply to serve as a starting point for anyone looking for the implementation. Please feel free to make a PR or create an issue if you find a bug or you want to contribute to improve any other aspect of the codebase.