Thank you for the link to the paper. I think that the conclusion of the blog post does also hold for sparse architectures like they are implemented in PyTorch Geometric. At work I have access to a 1080Ti ans 2080Ti and both work great, but comparably equal. There are also a lot of students of mine which run PyG on lower hardware and they never complained. I do not have access to any other setups, so it is quite hard to answer your question, e.g., I never played around with TPUs, but according to this paper GNNs can also be heavily accelerated by the use of TPUs and a clever memory layout.
Most helpful comment
Thank you for the link to the paper. I think that the conclusion of the blog post does also hold for sparse architectures like they are implemented in PyTorch Geometric. At work I have access to a 1080Ti ans 2080Ti and both work great, but comparably equal. There are also a lot of students of mine which run PyG on lower hardware and they never complained. I do not have access to any other setups, so it is quite hard to answer your question, e.g., I never played around with TPUs, but according to this paper GNNs can also be heavily accelerated by the use of TPUs and a clever memory layout.