The two teams will face off in the rubber match of the weekend series that saw the Rays win Friday and the Orioles on Saturday.
A late error proved to be costly for Tampa Bay on Saturday, and Rays first baseman Carlos Pena said they can't afford mistakes if they want to win.
"We are playing a worthy opponent and they are playing very good baseball all year up to this point," Pena said. "We have to come to play."
Sunday's game has big implications on the standings in the AL East. The rival clubs are currently tied atop the standings with the rest of the division fewer than three games behind them.
While the Rays continue to tread water due to injuries, they will look for a strong performance from Matt Moore, who allowed just two runs in his previous start. Rays manager Joe Maddon said the team must continue to pitch well if it wants to maintain success.
"The pitching has really been outstanding," Maddon said about his staff's adversity. "If we can maintain a high level of pitching efficiency, that's gonna give us the best chance to play at the end of the season into the playoffs. The hitting will come back. The defense will come back."
The difference Sunday could come down to the bullpens, as both have shown they can shut down opponents. The Rays' relievers had the lowest ERA for the month of May, but the Orioles don't slack late in games, either, as their relief corps has the lowest ERA on the season led by closer Jim Johnson, who picked up a key save on Saturday, his 17th of the season.
"You know you've got a really good [closer] when they can close a one-run game out on the road against the American League East," Orioles manager Buck Showalter said.
Orioles: Club looking to Arrieta to gain consistency
• Jake Arrieta will be taking the mound for Baltimore in the series' final game against Tampa Bay and will be looking for his first win since May 2.
The righty's last five starts have been particularly problematic, having given up four or more runs in four of the five. In his most recent appearance, Arrieta went 4 1/3 innings, giving up six runs on six hits and three walks in a loss to Toronto.
Arrieta is 2-2 all time against Tampa Bay and has a career 5.46 ERA and 20 strikeouts in 28 innings against the Rays.
Rays: Moore looking for second win of season
• He's come close, but Moore hasn't picked up a win in more than a month, a slide he hopes to end on Sunday. Last time out, the 22-year-old went seven innings with 10 strikeouts while allowing just two runs on four hits and a walk, but it wasn't enough, as the White Sox won, 2-1.
Moore will have a good chance to pick up his second win this season against a slumping Orioles team with help from the veterans of the pitching staff.
"Every series, it stays constant with us, between the starters -- 'What'd you do with this guy? What happened with him?'" Moore said. "We're in the dugout watching each at-bat and really trying to get a feel for what they're doing."
Moore took a loss in his last start against Baltimore after pitching just 4 1/3 innings, allowing four runs on four hits and four walks with six strikeouts.
• The Orioles acquired first baseman/outfielder Steve Pearce from the Yankees on Saturday, in exchange for cash considerations. Bill Hall was designated for assignment to make room on the roster.
• Rays outfielder Matt Joyce missed Saturday's game due to illness.