Forfar consigned Albion to an eighth successive defeat after running out 4-2 winners.
Rovers took the lead as Patrick Walker headed in Gary Phillips' 12th-minute corner, after the ball was helped on by the head of Marvin Andrews.
The home side levelled before the break with Danny Denholm turning in Gavin Malin's ball from the right.
Dale Hilson got to the byline and pulled back for Martyn Fotheringham to slot in five minutes after the break and, two minutes later, Hilson added a third with a driven effort into the top corner from 12 yards.
Albion were reduced to 10 men after Peter Innes received a second caution for bringing down Fotheringham, but Andrews headed in from another corner with 25 minutes left to give the bottom side hope.
The numbers were evened up with 12 minutes remaining as Denholm was shown a second yellow card for a foul on Barry Russell, but Malin made the game safe with a low drive from the edge of the area in the 83rd minute.