I find that I get much better performance on the ARM device.
Has this got anything to do with architecture?
Yes, it has.
Without trying to bore you with technical details, running code is a lot like following a cook book. Meanwhile, code that was written for a different platform is a lot like a cook book written in a foreign language.