Refresh of am4 chips released august 2024.
Ryzen 7 5700X OR Ryzen 7 5800X are sweet spot. Gives +20% single, +50% multi thread compared to my Ryzen 5 3600. Cost 5700X Oct 10, 2024: $219CDN, save $160 (total $379CDN). Wait for better deal, it should cost $156US=216 CDN
Latest (0.1.27) docker image with ROCm works for me on Ryzen 5600G with 8GB VRAM allocation. Prompt processing is 2x faster than with CPU. Generation runs at max speed even if CPU is busy running other processes. I am on Fedora 39. Container setup: HSA_OVERRIDE_GFX_VERSION=9.0.0
Use this to install ROCm on Tumbleweed. Does NOT talk about Pytorch, the tag is for completeness.
AMD's repo of Pytorch. This is the branch I succesfully built.
SHOWS EXACTS SPECS OF CPU OR APU INCLUDING GRAPHICS
$249, at Canadacomputers, they also have open box for $224. BUY THIS, NOT THE AMD Ryzen 5 5600GT(VEGA7), BECAUSE THIS HAS VEGA8, FASTER THAN VEGA7, AND SAME AS VEGA8 ON LAPTOP 2500U.
Compare Distinct graphics cards with AMD APUs. Result: Buy Ryzen 5700G, or AMD Ryzen 5 5600GT as GPU is the same. BUT Ryzen 5700G has 25% better CPU
Buy the Ryzen 5 5600GT (6 graphics cores, $189CDN) but also consider AMD Ryzen 7 5700G (8 graphics cores, now on sale $245CDN)
$189 in Canadacomputers
Database of AMD GPUs. Here we can see that 2500U is Vega 8 mobile , which is GCN 5.0. This is only supported in ROCm up to 4.5.2!!
Rusticl seems equivalent of rocm.
This site seems to claim there is a known fix. Looks like someone is fixing it???
Installing PyTorch for ROCm - this document claims gfx900 compatibility
Looks like gfx900, gfx902, gfx909 and gfx90c are the same
Pytorch packages from AMD. Goes with amdgpu-install packages in https://repo.radeon.com/amdgpu-install/
Repo of rocm (amdgpu) packages from amd. The last version 4, 4.5.2 is under 21.40.2. Try to install with Kernel 5.4 (release 2020). Same packages under different old names are at https://repo.radeon.com/rocm/apt/
Suggested git-build of pytorch on gfx90c FAILED for me
LM Studio can be installed on Linux with APU or GPU (looks like it needs the AI CPU though??) and run LLM. Install on Laptop and test if it works.
Install PyTorch corresponding to rocm versions from Pytorch prebuild by AMD. Also has post-install validation
Test for PyTorch and ROCm after installing ROCm.
A program that changes VRAM / UMA size in BIOS on AMD APU, even if VRAM / UMA does not show in BIOS
If you have AMD GPU as I do then you can grab PCI ID for the device with lspci command executed with -D flag (shows PCI doamin) and read the following file cat /sys/bus/pci/devices/${pci_slot}/mem_info_vram_total, it contains GPU VRAM size in bytes.
8000G is the APU series for AI
Top of the guide describing ROCm on Linux. There are 2 core approaches: Using RPM (Package manager), or using AMD installer. I should use Package manager. Also single-version vs. multi-version. I should use single-version, latest.
The links in “How to guide“ provide instructions that are hopeful. Maybe start with those instructions!
Another rocm installation claim on Opensuse. Interesting note: I realize this is a bit old, but you don't really need amdgpu from the repository: it comes for free with the kernel. amdgpu-dkms is only needed if you're stuck on an older kernel version and you can't upgrade for some reason. For example, Tumbleweed users will not need it..
This guy seems to claim ROCM can run on Tumbleweed using Distrobox. But what is distrobox?
This guy claims successful installation of ROCm on Ubuntu - this seems to be workable for Tumbleweed as well. See the comment “nav9 commented on Jul 16, 2023“
AMD seems to sell these accelerators, which are like video cards.
Train LLM on AMD APU. In this scenario, we’ll use an APU because most laptops with a Ryzen CPU include an iGPU; specifically, this post should work with iGPUs based on the “GCN 5.0” architecture, or “Vega” for friends. We’ll use an AMD Ryzen 2200G in this post, an entry-level processor equipped with 4C/4T and an integrated GPU.
Ryzen 7 5700X3d (no GPU) and 5600GT 9with GPU) are NEW 2024, still for am4 platform, check if motherboard supports and buy, probably the GT.
