Albion were denied a crucial win in their race to avoid the relegation play-off spot as Arbroath fought back for a point from a 1-1 draw.
The Wee Rovers went closest to breaking the deadlock before the break when Robert Love's strike was tipped round the post by Darren Hill.
John Gemmell headed over the bar from close range and Hill was alert again to keep out another Love effort as Albion showed the greater urgency.
Rovers made the breakthrough four minutes after the break, with Love finally finding a way past Hill.
Hill thwarted Scott Chaplain to keep Arbroath in the game and the visitors' resistance was rewarded when Lee Sibanda shot into the roof of the net in the 72nd minute.
The point was not enough to keep alive Arbroath's title hopes, with Cowdenbeath's win over Forfar sealing their promotion.