Mark McGuigan's strike 10 minutes from time gave Albion a 2-1 victory over mid-table rivals Stranraer.
Jason Crooks had headed the hosts into a 49th-minute lead, before Christopher Aitken equalised 10 minutes later, but McGuigan was on hand to take maximum points for his side.
McGuigan, a 19th-minute substitute, set his sights on goal in the first half when he sent a volley over the bar from distance, while Stranraer's Robert Love tested Ryan McWilliams at the other end.
Crooks' header from Anthony Stevenson's cross found the bottom corner of the goal to break the deadlock after the restart.
But Aitken soon had his team level with a cultured finish from six yards.
The game looked to be heading for a draw before Stevenson again turned provider as he fed McGuigan, who drilled the ball past David Mitchell in the Stranraer goal.