Is there a way to restrict clipboard, file transfer, or USB access for specific users?

Yes. Session settings can be configured on the Frame Account, Sandbox, and LaunchPad levels.