Ross Archibald gave Spartans the lead before Ross Millar equalised, then Donal Henretty appeared to have rewarded the visitors with all three points. However, Liam Jack popped up to bundle the ball into the net following a corner.
Edinburgh City, who appointed Gary Jardine and John Green as their new management team after the resignation of Shaun Steven, defeated Edinburgh University 2-0 at Peffermill. After a goalless first-half Ian McFarland put City ahead before Dougie Gair ensured their win with a 16-yard shot.
In the First Division, John Jardine and Dan Carmichael scored in a 2-1 victory for Gretna 2008 against Eyemouth United who scored through Kieran Ainslie.
Lothian Thistle progressed to the quarter-finals of the SFA South Region Challenge Cup with an extra-time 3-1 win against Preston Athletic, thanks to goals from Mark Lothian, Wayne McIntosh and Jim Young.