Darren Lavery rescued Berwick with a late goal meaning it is all to play for after the first leg of their Second Division play-off semi-final with East Fife ended 1-1.
The Fifers were in charge from the off and Scott McBride, Paul McManus and Collin Samuel were all denied.
They were eventually rewarded for their dominance in the 44th minute when David Muir headed home Craig Johnstone's cross from the right byline.
The second half was a different story, though, as the Borderers chased a leveller and Steven Notman headed over a good chance from a corner.
Lavery also shot wide, before he made the vital breakthrough, converting Scott Dalziel's centre from close range with 18 minutes remaining.
Neither side could force a winner, meaning it goes into Saturday's second leg all to play for.