lucidrains/imagen-pytorch

No such file or directory

lijain opened this issue · 0 comments

lijain commented

I run first:
import torch
from imagen_pytorch import Unet, Imagen

unet for imagen

unet1 = Unet(
dim = 32,
cond_dim = 512,
dim_mults = (1, 2, 4, 8),
num_resnet_blocks = 3,
layer_attns = (False, True, True, True),
layer_cross_attns = (False, True, True, True)
)

unet2 = Unet(
dim = 32,
cond_dim = 512,
dim_mults = (1, 2, 4, 8),
num_resnet_blocks = (2, 4, 8, 8),
layer_attns = (False, False, False, True),
layer_cross_attns = (False, False, False, True)
)

imagen, which contains the unets above (base unet and super resoluting ones)

imagen = Imagen(
unets = (unet1, unet2),
image_sizes = (64, 256),
timesteps = 1000,
cond_drop_prob = 0.1
).cuda()

mock images (get a lot of this) and text encodings from large T5

text_embeds = torch.randn(4, 256, 768).cuda()
images = torch.randn(4, 3, 256, 256).cuda()

feed images into imagen, training each unet in the cascade

for i in (1, 2):
loss = imagen(images, text_embeds = text_embeds, unet_number = i)
loss.backward()

do the above for many many many many steps

now you can sample an image based on the text embeddings from the cascading ddpm

images = imagen.sample(texts = [
'a whale breaching from afar',
'young girl blowing out candles on her birthday cake',
'fireworks with blue and green sparkles'
], cond_scale = 3.)

images.shape # (3, 3, 256, 256)

FileNotFoundError: [Errno 2] No such file or directory: '/mnt/cache/xxx/.cac
he/huggingface/hub/models--google--t5-v1_1-base/refs/main'
srun: error: xx-IDC1-10-142-5-20: task 0: Exited with exit code 1