I recently just beat Borderlands 1. There are a couple more missions left, but now I'm left wondering which Borderlands is next?

I own Borderlands 2 but now the Pre-Sequel is out and apparently that is supposed to be set before Borderlands 2?

If that's the case, what is the canonical order to play the Borderlands series?