Arsenal’s winning was brought to an end with a controversial 2-2 draw at Crystal Palace.
The first trickle of hope for the Eagles came from their frontman, Wilfried Zaha, who struck the post followed up by Andrew Townsend who shot wide a few moments later.
The Gunners also had two chances in quick succession when Alexandre Lacazette managed an effort from the edge of the penalty area which went just wide and Hector Bellerin’s shot from close range was blocked.
Palace were awarded a penalty in the final minute of the first half, as Mustafi brought down Cheikhou Kouyate with a reckless sliding challenge.
Milivojevic, who missed from the spot at Everton last week, made no mistake this time to score Palace’s first home goal of the season and ensured his side were leading at the break.
Arsenal were leveled soon after the break after a free kick was given away by Milivojevic on the edge of his own area, and Granit Xhaka fired it into the top corner to equalize.
Arsenal showed their second-half superiority as in the last games they won when they went in front after 56 minutes.
Again Lacazette appeared to brush a corner onwards with his hand, and Aubameyang was able to scruffily tap in at the far post, with the ball proving to have crossed the line by just nine millimetres.
However, after a long half of defending, Arsenal gave away another penalty in the 82nd minute when Xhaka fouled Zaha, and Milivojevic was on hand again to give Palace a point.
Arsenal missed the chance to climb above Manchester City into third place, but remain unbeaten since their second game of the season.