McGinn came on with 20 minutes or so remaining and scored with a clever backheel in the closing moments of the game.
Stephen had also been on the bench - but was an unused sub - when Scotland played Albania at the weekend, while Saints team mate Marc McAusland was an unused sub in both games.