nicklashansen/tdmpc

Question about base.device

pickxiguapi opened this issue · 1 comments

pickxiguapi commented

Hi! thanks for this excellent paper and it inspired me a lot!

In my experiment, I'm confused about the device setting in cfg.py:

tdmpc/src/cfg.py

Line 45 in 96cb703

base.device = 'cuda' if base.modality == 'state' else 'cpu'

I don't understand why we need to make pixel's environment(modality=='pixels') based on cpu and state's environment(modality=='state') based on gpu(cuda), is there any special purpose for this setting?

nicklashansen commented

Hi, sampling is slightly faster when the replay buffer is entirely in GPU memory. This is feasible for state observations but likely not pixel observations, depending on your hardware. I'm closing the issue; feel free to reopen if you have further questions!