Odin at his peak could not really stop the Destroyer, how can Thor?
It's only ever been stated that the Armor was capable of being a threat to Odin..but was never ever shown as being one...Thor with Odins power destroyed it a number of times in canon and what if's...