Albers will get an MRI exam in Baltimore on Friday, manager Dave Trembley said.
Albers lasted just one-third of an inning in an emergency start against the Chicago Cubs on Wednesday. Starting for the sick Brian Burres, Albers faced five batters and threw 21 pitches before he left with shoulder discomfort. Albers gave up three hits, four runs and a walk.
Cabrera started the season on the DL after offseason elbow surgery. He had an 0.69 ERA in 13 innings with Triple-A Norfolk.