Since "Edit" permission gives privilege to copy and move, I believe it's not possible to override that behavior.
Though it's not a standard approach, one option could be to inject css with extension and hide those elements.
FYI, below article says, if you uncheck "Prevent users from running custom script" Copy To/Move will not be visible(I haven't tried). But this might disrupt other features.
Sharepoint online move/copy to functions disappeared
You can use the git repo from below mentioned article. In that code, in oninit method, you need to add additional condition, to add css file only if current user is in required role\group.
How to Inject Custom CSS in Modern Sites
To get the current user details plz check here
Get current user's user group in SPFx WebPart