• DarkThoughts@fedia.io
    link
    fedilink
    arrow-up
    5
    ·
    11 days ago

    I’d already be happy if AMD goes with 24 GB on their upper midrange cards, but I would not be surprised if they stick with 16 GB. 48 GB seems extremely unlikely, unfortunately.

    Doing LLMs with 8 GB is not fun, especially not with RDNA 2 which has so many issues with ROCm.