Kevin McDonald fired Berwick to a 2-1 win over play-off rivals Elgin at Borough Briggs.
City opened the scoring when striker Stuart Leslie stroked home a seventh-minute penalty a foul by Damian Gielty on Brian Cameron.
Berwick dominated the rest of the first half and Darren Lavery hit a post on the stroke of half-time.
In the second half Berwick's pressure finally told when Lavery buried a shot from 12 yards on 65 minutes.
They struck again 10 minutes later when midfielder McDonald headed in a Lee Currie corner from six yards.
Striker Daniel Moore nearly equalised for Elgin with a long-range effort injury time but Berwick held on.