Afolabi Obafemi scored the decisive goal after only nine minutes to hand Stortford their first three points of the new season.
The Pilgrims pushed hard to find a leveller but the most damning statistic of the afternoon was that home keeper Luke Chambers did not have a save to make.