Yet Another Bookmarks Service



[https://github.com/ollama/ollama/issues/2637] - - public:mzimmerm
amd, apu, gfx900, install, pytorch, rocm - 6 | id:1491350 -

Latest (0.1.27) docker image with ROCm works for me on Ryzen 5600G with 8GB VRAM allocation. Prompt processing is 2x faster than with CPU. Generation runs at max speed even if CPU is busy running other processes. I am on Fedora 39. Container setup: HSA_OVERRIDE_GFX_VERSION=9.0.0

[https://www.videocardbenchmark.net/compare/4086vs3548vs4405vs4989vs3930/GeForce-GTX-1060-(Mobile)-vs-GeForce-GTX-1060-vs-Ryzen-7-5700G-with-Radeon-Graphics-vs-Radeon-Ryzen-5-5600GT-vs-Ryzen-5-2500U-with-Radeon-Vega] - - public:mzimmerm
amd, apu, compare, gpu, passmark - 5 | id:1490036 -

Compare Distinct graphics cards with AMD APUs. Result: Buy Ryzen 5700G, or AMD Ryzen 5 5600GT as GPU is the same. BUT Ryzen 5700G has 25% better CPU

[https://www.cpubenchmark.net/compare/3481vs5885vs4323vs4325vs3123/AMD-Ryzen-5-3600-vs-AMD-Ryzen-5-5600GT-vs-AMD-Ryzen-7-5700G-vs-AMD-Ryzen-5-5600G-vs-AMD-Ryzen-5-2500U] - - public:mzimmerm
amd, compare, cpu, passmark - 4 | id:1490035 -

Buy the Ryzen 5 5600GT (6 graphics cores, $189CDN) but also consider AMD Ryzen 7 5700G (8 graphics cores, now on sale $245CDN)

[https://www.techpowerup.com/gpu-specs/?mfgr=AMD&architecture=GCN%205.0&sort=generation] - - public:mzimmerm
amd, apu, database, gcngpu, gfx902, good, gpu - 7 | id:1490009 -

Database of AMD GPUs. Here we can see that 2500U is Vega 8 mobile , which is GCN 5.0. This is only supported in ROCm up to 4.5.2!!

[https://repo.radeon.com/amdgpu-install/] - - public:mzimmerm
amd, amdgpu, repo, rocm - 4 | id:1489975 -

Repo of rocm (amdgpu) packages from amd. The last version 4, 4.5.2 is under 21.40.2. Try to install with Kernel 5.4 (release 2020). Same packages under different old names are at https://repo.radeon.com/rocm/apt/

[https://stackoverflow.com/questions/77708142/how-can-i-fetch-vram-and-gpu-cache-size-in-linux] - - public:mzimmerm
amd, apu, command, linux, memory - 5 | id:1489838 -

If you have AMD GPU as I do then you can grab PCI ID for the device with lspci command executed with -D flag (shows PCI doamin) and read the following file cat /sys/bus/pci/devices/${pci_slot}/mem_info_vram_total, it contains GPU VRAM size in bytes.

[https://civitai.com/articles/2296/how-to-install-rocm-on-opensusesuse] - - public:mzimmerm
amd, gpu, rocm - 3 | id:1489831 -

Another rocm installation claim on Opensuse. Interesting note: I realize this is a bit old, but you don't really need amdgpu from the repository: it comes for free with the kernel. amdgpu-dkms is only needed if you're stuck on an older kernel version and you can't upgrade for some reason. For example, Tumbleweed users will not need it..

[https://medium.com/@rafaelmanzanom/ditching-cuda-for-amd-rocm-for-more-accessible-llm-inference-ryzen-apus-edition-92c3649f8f7d] - - public:mzimmerm
ai, amd, apu, compile, gfx902, install, pytorch, rocm - 8 | id:1489810 -

Train LLM on AMD APU. In this scenario, we’ll use an APU because most laptops with a Ryzen CPU include an iGPU; specifically, this post should work with iGPUs based on the “GCN 5.0” architecture, or “Vega” for friends. We’ll use an AMD Ryzen 2200G in this post, an entry-level processor equipped with 4C/4T and an integrated GPU.

[https://www.tomshardware.com/pc-components/cpus/amds-new-cheap-gaming-chip-is-25-faster-than-intels-more-expensive-alternative-ryzen-7-5700x3d-is-faster-than-core-i5-13600kf-in-early-reviews-even-on-aging-am4-platform] - - public:mzimmerm
amd, buy, cpu - 3 | id:1489473 -

Ryzen 7 5700X3d (no GPU) and 5600GT 9with GPU) are NEW 2024, still for am4 platform, check if motherboard supports and buy, probably the GT.

Follow Tags