When you buy a new weapon it replaces whatever you were currently carrying of the same type, but I cannot seem to find a way to switch back to previous weapons.
The shops just have previous items flagged as "already owned" (or purchased, can't remember the text at the moment) and the inventory only seems to list my current selections.