Install Pytorch on ROCm from AMD git repo. TRY THIS!!!
Describes flags that build PyTorch locally - maybe I should try that!!
This guy claims he got both gfx900 and gfx902 working. I asked to try my test.
Another attempt failed for me.
Database of AMD GPUs. Here we can see that 2500U is Vega 8 mobile , which is GCN 5.0. This is only supported in ROCm up to 4.5.2!!
Rusticl seems equivalent of rocm.
This site seems to claim there is a known fix. Looks like someone is fixing it???
Installing PyTorch for ROCm - this document claims gfx900 compatibility
Looks like gfx900, gfx902, gfx909 and gfx90c are the same
Pytorch packages from AMD. Goes with amdgpu-install packages in https://repo.radeon.com/amdgpu-install/
Repo of rocm (amdgpu) packages from amd. The last version 4, 4.5.2 is under 21.40.2. Try to install with Kernel 5.4 (release 2020). Same packages under different old names are at https://repo.radeon.com/rocm/apt/
Suggested git-build of pytorch on gfx90c FAILED for me
venv is Python build-in module; pyvenv is Python script on top of venv. pyenv is a OS-level thing. All of them allow to create virtual environments
Document about LM Studio
180 Celsius for 30 minutes
Optimum is an extension of Transformers that provides a set of performance optimization tools to train and run models on targeted hardware with maximum efficiency. It is also the repository of small, mini, tiny models.
Excellent document about BERT transformers / models and their parameters: - L=number of layers. - H=size of the hidden layer = number of vectors for each word in the sentence. - A = Number of self-attention heads - Total parameters.
Repository of all Bert models, including small. Start using this model for testing.
LM Studio can be installed on Linux with APU or GPU (looks like it needs the AI CPU though??) and run LLM. Install on Laptop and test if it works.
Index of all python packages. pip looks here first to find a package.
Install PyTorch corresponding to rocm versions from Pytorch prebuild by AMD. Also has post-install validation
Test for PyTorch and ROCm after installing ROCm.
Follow falling prices
My account on SageMaker studio. The give out 4 hours of GPU a day!
A program that changes VRAM / UMA size in BIOS on AMD APU, even if VRAM / UMA does not show in BIOS
If you have AMD GPU as I do then you can grab PCI ID for the device with lspci command executed with -D flag (shows PCI doamin) and read the following file cat /sys/bus/pci/devices/${pci_slot}/mem_info_vram_total, it contains GPU VRAM size in bytes.
