A demo to show how to use the TPU in google colab.
It is almost the same as training a normal keras model, except that
you need to use tf.contrib.tpu.keras_to_tpu_model
to transfer
the model to TPU:
tpu_model = tf.contrib.tpu.keras_to_tpu_model(
model,
strategy=tf.contrib.tpu.TPUDistributionStrategy(
tf.contrib.cluster_resolver.TPUClusterResolver(tpu=TPU_ADDRESS)
)
)
tpu_model.compile(
optimizer=tf.train.AdamOptimizer(learning_rate=1e-3, ),
loss=tf.keras.losses.sparse_categorical_crossentropy,
metrics=['sparse_categorical_accuracy']
)
You can find more info in the code or checkout the colab notebook