Ability to link or unlink a record in the related record list without the ability to edit other items in the list.

I want my users to be able to "remove" an item from a list - sever the link between the two, and ALSO, I want them to "add" an item to a list, without the ability to remove other items!