Dylan Easton scored direct from a corner as Berwick beat second-placed Queen's Park 2-0.
The striker netted his third goal of the season with an hour gone and Neil Janczyk got in on the act soon afterwards to make it five games unbeaten for Rangers.
Berwick's Scott Dalziel's low shot forced Neil Parry to save with his feet in the opening three minutes.
Fraser McLaren, looking to add to his 10-goal haul this season, was off target early in the second half as the hosts continued to control proceedings.
And their breakthrough goal came in the unlikeliest of circumstances when Easton's left-wing corner eluded everyone and found the bottom-right corner.
Easton turned provider to set-up Janczyk to stroke home the second from 12 yards with 14 minutes left.