A tight affair was played out at Murrayfield as the Storm ended the weekend with four points to show for their weekend efforts.
The first period failed to find a goal with both teams not giving much away, setting the scene for what was a tough night for the visitors.
Mike Hammond went close early in the second when his effort hit the bar, but Dane Byers got the opener with a shot that finally beat Caps goalie Pavel Shegalo.
Jay Rosehill was ejected from the game for a checking to the head call, allowing Edinburgh to take advantage with the powerplay.
They levelled through Dylan Anderson, but the joy was short-lived as Luke Moffatt was in the right place to put the visitors in front again.
Edinburgh showed some urgency in the third as they looked to get something out of the game, but Bakker’s marker late on eased any late worries as victory was assured.