Thanks for being a part of WWDC25!

How did we do? We’d love to know your thoughts on this year’s conference. Take the survey here

Why doesn't tensorflow-metal use AMD GPU memory?

From tensorflow-metal example: Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 0 MB memory) -> physical PluggableDevice (device: 0, name: METAL, pci bus id: <undefined>)

I know that Apple silicon uses UMA, and that memory copies are typical of CUDA, but wouldn't the GPU memory still be faster overall?

I have an iMac Pro with a Radeon Pro Vega 64 16 GB GPU and an Intel iMac with a Radeon Pro 5700 8 GB GPU.

But using tensorflow-metal is still WAY faster than using the CPUs. Thanks for that. I am surprised the 5700 is twice as fast as the Vega though.

Answered by DTS Engineer in 836886022

Hello,

Please send us an enhancement request using the Feedback Assistant.

Otherwise we acknowledge your points on performance.

Hello,

Please send us an enhancement request using the Feedback Assistant.

Otherwise we acknowledge your points on performance.

Why doesn't tensorflow-metal use AMD GPU memory?
 
 
Q