tuned-amdgpu

Hacky solution to integrate AMDGPU power control and overclocking in tuned with Ansible.

TLDR: See my host_vars for an overview.

A host will have a collection of tuned profiles. For example: desktop, balanced, virt-host

This role extends those with AMD GPU power/clock/voltage control. Each gets default, overclock, and peak variations.

An attempt is made to discover the active GPU using the 'connected' state in the DRM subsystem, example:

~ $ grep -ls ^connected /sys/class/drm/*/status | grep -o card[0-9] | sort | uniq | sort -h | tail -1
card1

Warning: This is only tested with RX6000 series GPUs, it is probable that other generations will not work properly. Use at your own risk!

Profiles

Two 'profiles' are in each name:

Output profile	Description
`balanced-amdgpu-default`	Includes the (assumed) existing `balanced` tuned profile. Only adjusts the GPU power limit (typically lower). Clocks/voltage curve remain the default.
`desktop-amdgpu-overclock`	Includes the (assumed) existing `desktop` tuned profile. Adjusts the GPU power limit, clocks, and the voltage curve.
`desktop-amdgpu-peak`	Includes the (assumed) existing `desktop` tuned profile. Same as the `overclock` profile, but locks clocks to their highest configured values

The playbook will render this config file: /etc/tuned/amdgpu-profile-vars.conf

Here is a preview:

gpu_clock_min=500
gpu_clock_max=2715
gpumem_clock_static=1075
gpu_power_multi_def=0.869969040247678
gpu_power_multi_oc=1.0
gpu_mv_offset=+60

Changes to this config are not immediately effective. Doing so requires switching tuned profiles or restarting the service.

To ignore this limitation, one can use gamemode for dynamically switching. Sample ~/.config/gamemode.ini below:

[custom]
start=tuned-adm profile latency-performance-amdgpu-overclock
end=tuned-adm profile latency-performance-amdgpu-default

See this Arch Wiki link for more comprehensive information.

These are the variables you'll want to change/consider.

Variable	Description
gpu_clock_min	Sets the min (dynamic) GPU clock (in `Mhz`) for the non-default `amdgpu` profiles
gpu_clock_max	Sets the max (dynamic) GPU clock (in `MHz`) for the non-default `amdgpu` profiles
gpumem_clock_static	Sets the static memory clock for the GPU (in `MHz`). This is not the effective data rate. That would be a multiple of this depending on the type of VRAM. To avoid flickering this is not allowed to change with load, only between `default` and `overclock`/`peak` profiles.
gpu_mv_offset	GPU core voltage offset. Takes +/- some integer in millivolts. Can be used to both over and under volt. eg: `-50` (undervolt `50mV` or `0.05V`)
base_profiles	List of base tuned profiles to clone in the new AMDGPU profiles. Defaults based on `Fedora`
gpu_power_multi_def	Float between `0.0` and `1.0`; controls power limit relative to the board capability. For 'default'-named power profiles.
gpu_power_multi_oc	Similar to `gpu_power_multi_def`, for 'overclock'-named power profiles.