You have to setup defensive positions. This may mean a couple of archers and a ground unit. Throw them on hills, near water to block (like the movie 300). Keep the options of retreating towards a city so you can bombard using the city.
Montie's Jaguar warriors run through Jungle without penalty. So you can't rely on Jungle to slow him down and most likely he will reach units (archers) you feel are otherwise safe. Think opposite.
If you are able to get some cash from ruins, you may be able to buy an archer which will give you an edge. However, you may not be able to build that first scout as you should build a warrior. You will then have up to 20 turns with those warriors to find any local ruins.
Once you take down a couple of his units, he will retreat. Preserve you new experienced units and upgrade them as crack troops.
As for deleting him. I think the best you can do is an advanced game setup which you can pick the civilizations to play against. Not very random or fun and i don't think you really want to do that. So learn to beat him when you think he is on the map.