use-package is a macro, NOT a package manager. It can call either package.el (the default emacs package manager which uses MELPA but other package repo can be added) or straight.el (the new package manager alternative which allows to use package repos as package.el BUT also allows to use custom defined, git-sourced package repos)

Try this to install ROCm v 4.something. Use Kernel up to 5.4 to be safe (5.4 started in 2020)

AMD's repo of Pytorch. This is the branch I succesfully built.

AMD repo for their PyTorch version.

Pytorch packages from AMD. Goes with amdgpu-install packages in https://repo.radeon.com/amdgpu-install/

Repo of rocm (amdgpu) packages from amd. The last version 4, 4.5.2 is under 21.40.2. Try to install with Kernel 5.4 (release 2020). Same packages under different old names are at https://repo.radeon.com/rocm/apt/

Optimum is an extension of Transformers that provides a set of performance optimization tools to train and run models on targeted hardware with maximum efficiency. It is also the repository of small, mini, tiny models.