First go to "My Publications".

Scroll down to your "Collections" and navigate to the collection you want to remove a magazine from and click on "Open Collection".

Click on the "Edit" Button at the right side:

Then select the 'x' button at the magazine/s you want to remove from your collection/section.