Christie Elliot scored and received a red card in an eventful 2-0 win for bottom-placed Division Two Albion at home to Ayr.
David Winters should have broken the deadlock for the visitors five minutes into the game, but he saw his close-range effort balloon over the crossbar.
It was the Wee Rovers who then went ahead, after 24 minutes, when Anthony Stevenson gave the hosts the lead with a stunning 30-yard effort.
Levin Green almost doubled the advantage, four minutes before the break, but he was unable to apply the finish to Alan Reid's cross.
Todd Lumsden's side found a crucial second goal in the 69th minute, when Elliot headed home Ciaran Donnelly's assist to wrap up the points.
Elliot was sent off for violent conduct seven minutes later, but the home side held on to record only their second win in 13 games, moving themselves to within three points of the Honest Men.