Albion have been relegated from the Irn-Bru Scottish Second Division after a 4-1 defeat at second-placed Alloa.
Kevin Cawley struck the crossbar after just three minutes and seconds later the former Celtic youngster broke the deadlock when he headed in Stephen Simmons' cross.
The Wasps were pegged back soon after, however, as Patrick Walker guided Ciaran Donnelly's cross into the bottom corner after 18 minutes.
Todd Lumsden's side knew anything less than victory would see them go down but were level for just four minutes as Simmons found the top corner with an emphatic right-footed strike from the edge of the area.
In the 31st minute the hosts extended their advantage, Calum Elliot providing Jonathan Tiffoney with a simple finish for his second goal in as many games.
Paul Hartley's men wrapped up their victory with four minutes left as Cawley got the final touch on Edward Ferns' assist to seal the Wee Rovers' fate.