Services Restrictions

Hi All, I have trouble setting up restrictions on our server. We would like our cpaneld be open to ALL but I would like to restrict certain cpanel accounts to just our IP. How would we accomplish that? Host Access Control doesn't give much options to us.