Manchester United's Wayne Rooney is congratulated by team mates after scoring his team's second goal against Crystal Palace on September 14, 2013 © Getty Images

The hosts started strongly and Michael Carrick forced Julian Speroni into an early save from his long-range effort.

United thought they should have had a penalty when Patrice Evra went down under the challenge of Mile Jedinak inside the area but their appeals were waved away by referee Jon Moss.

There was another penalty shout minutes later when Ashley Young went down over the leg of Kagisho Dikgacoi but this time the referee booked the United player for a dive.

Robin van Persie nearly opened the scoring five minutes before the break but his spectacular volley from Wayne Rooney's pass came back of the bar.

Crystal Palace had a golden chance to take the lead in the 42nd minute through Dwight Gayle when he latched onto a long ball but could only poke wide with only the keeper to beat.

The home side finally took the lead at the end of the half when Dikgacoi brought Young down with the winger through on goal, leaving the referee with no choice but to send the Palace man off.

Robin van Persie calmly converted from the spot by sending Speroni the wrong way to give United the lead.

Manchester United's Robin van Persie scores the opener from the penalty spot against Crystal Palace on September 14, 2013 © Getty Images

Chances were limited in the second half but the home fans had something to cheer when new singing Marouane Fellaini came on for his Manchester United debut just past the hour mark.

Ashley Young and Van Persie both fired wide as United looked to seal the victory but it was the returning Wayne Rooney who ensured the points were safe 10 minutes from the end.

The England striker curled a free kick over the wall and into the bottom corner that gave Speroni no chance to give the current title holders a much-needed win and a first victory at Old Trafford for new manager David Moyes.