Yes you can!
You may navigate to the “Starred” tab on the Contacts section, from your dashboard.
All your starred talents will appear with a fellow icon on their avatar, like shown above.
Click on the yellow star icon to remove the person from your starred talent list.