probably you can do that by editing your ItemInfo.tpl from core directory.
replace this: {g->text text="Views: %d" arg1=$item.viewCount}
with: {if $user.isAdmin }{g->text text="Views: %d" arg1=$item.viewCount}{/if}
then clear you template cache.
i did not tested but i have use this method to the sizelimit module and worked.