Getting his fourth career homer off Guthrie, Jim Thome hit a solo shot to put the twins up by one in the second inning.
Thome added another run for the Twins in the sixth inning on a single to center field, which scored Alexi Casilla, who singled.
Michael Cuddyer went deep to take the lead to three runs in the eighth inning.
The Orioles got on the board in the eighth inning. Brian Roberts drew a walk and moved to third on a double by Derrek Lee. Roberts came around to score the lone run when Vladimir Guerrero singled up the middle.
Despite a good outing for a quality start, Guthrie has a total lack of run support once again. Over seven innings of work, Guthrie allowed two runs on seven hits with both runs coming off the bat of Thome. He walked none and struck out four, throwing 69 of his 104 pitches for strikes. He hadn't hit any batters coming into the game but hit two tonight. Guthrie has allowed two or fewer runs in three of his four starts.
Michael Gonzalez came on in relief in the eighth inning, going 0.2 innings. He gave up a run on two hits. Taking over for Gonzalez, Jeremy Accardo finished the inning and work through the ninth, retiring all four batter he faced.
Baker went seven scoreless innings, giving up four hits and striking out nine with one walk. He retired the Birds in order four times on the night. He went to 6-0 lifetime against the Orioles with a 2.17 ERA.
Jose Mijares relieved for 0.2 innings, surrendering a base on balls. Jim Hoey worked no part of an inning as he gave up a run on two hits. Glen Perkins worked the remainder of the eighth, getting the final out on a grounder by Luke Scott. Closer Matt Capps came on in the ninth, giving up a hit and getting two fly balls and a strike out to end the game.
Oriole bats could not get it going tonight, going the entire game without getting the leadoff man on base. They stranded eight base runners and were one for seven with runners in scoring position. Matt Wieters extended his hitting streak to five games while Adam Jones had his snapped at six. Wieters and Guerrero both had two hits on the night while the rest of the team combined for three.
In tomorrow's series opener against the Yankees, Brad Bergesen (0-2) will go for his first win on the season as he faces C.C. Sabathia (0-1).