Based on the error message, it seems like I can delete multiple indexes at the same time. I tried it, and it works.
However, the Delete command portion in the UG has no mention of the possibility of multiple delete, which I only got to know from an unexpected error message.