As of 22nd Sept 2025, narrowly scoped role that allows only adding/removing entries in Custom URL (or Custom URL Groups) is not available for Customer Admins yet