Possible replacement of gpu #105

Considering the architectural differences, such as the Systolic Array in TPUs versus the general-purpose parallel processing in GPUs, do you believe TPUs will eventually replace GPUs as the standard for LLM training, or will the flexibility of GPUs remain irreplaceable for new research?