Have you properly uninstalled the Nvidia Drivers and THEN installed the AMD Drivers using DDU (Display Driver Uninstaller) ? Also check if Resizable BAR / SmartAccess Memory is enabled in the BIOS/UEFI. Lastly, I have made the experience that Depth of Field just destroys performance, disabling it solved that for me.