Yes, this is a bug with the armory. If you're using the armory to change between builds, don't.
Undo everything you've saved in the armory on all your characters by taking out your gems and overriding them with whatever gear you have on.
Only way to get it back is via rollback.