A last-minute goal from Ryan Beveridge gave United their first league win since October, lifting the Tweedsiders off the bottom of the table.
It was a hard-earned victory, with both teams equally matched, and manager Prof Blaikie was delighted to capture the points.
“The boys deserved this,” he said. “They have been playing well without getting any luck, but this win will give the team some confidence.”
The game was fairly nondescript for the first 20 minutes, with both teams bogged down in midfield encounters.
United came to life just before the break with a last-ditch tackle from visiting defender Graeme Haywood preventing a certain opener from Ryan Beveridge.
The Tweedsiders went ahead on the hour mark when Andrew Oldham set up Ben Herdman, who fired a fierce shot into the bottom corner from 20 yards.
The visitors got on level terms after 82 minutes, however.
A free kick on the left edge of the box was taken by Dale Robertson, the ball bouncing through to Craig Lowe, who bundled the ball over the line from close range.
A swinging shot from 35 yards by Boyne had Shipyard keeper Barry Thomson scrambling as the goalie just managed to tip the midfielders effort over the bar.
The match was into the dying seconds when Beveridge burst from midfield before shooting from 20 yards, the ball bouncing over the diving Thomson and into the net to give United victory.