Christian Benteke cancelled out Arsenal's opener before putting Aston Villa ahead from the penalty spot.
Arsenal's day got worse when Laurent Koscielny was sent off after picking up two yellow cards.
And Antonio Luna made sure of the points by scoring Aston Villa's third late on.
Robin van Persie opened the scoring to help Manchester United on the way to victory against Swansea.
Van Persie grabbed another, while Danny Welbeck also hit a brace as United strolled to victory.
Daniel Sturridge broke the deadlock for Liverpool against Stoke just before half-time with a fine strike.
Liverpool held on to victory thanks to Simon Mignolet, who saved Jon Walters' last-minute penalty.
Rickie Lambert continued his perfect week by scoring Southampton's winner against West Brom.
Seamus Coleman wheels away after putting Everton 2-1 up against Norwich.
Ricky van Wolfswinkel had the final say, equalising for Norwich on his debut for the club.
Joe Cole scored West Ham's first as they saw off new boys Cardiff 2-0.
Pajtim Kasami's second-half header was enough to secure victory for Fulham at Sunderland.