And the Huddersfield fans finally had reason to celebrate after four games without a goal as Kolasinac turned into his own net in the 93rd minute, while Leno then saved from Juninho Bacuna to protect Arsenal's victory.
The result kept the Gunners in the thick of the chase for a top-four finish and Champions League football although questions remain about their defensive frailty.
Not that Emery was too concerned about that late blot on his team's performance.
Huddersfield pressed and harried but rarely troubled the Arsenal goal in the first half, with the difference in quality showing as the visitors doubled their advantage through Alexandre Lacazette's 10th league goal of the season a minute before halftime.
"The clean sheet is important but our goal is to win". "The main thing is to score one more goal than them and, after that, it is to keep a clean sheet".More news: Theresa May Promises U.K. Lawmakers Brexit Vote by February 27
More news: Two more ‘significant’ winter storms headed for western Washington
More news: Share The Love Event Coming to Fortnite February 8
It is great for us Arsenal fans that we came away with the points, and it must be very frustrating for the Terriers, but let us not get carried away and think that we are back on course after this lucky win.
"I would overhaul the roster [rather than sack the manager at Chelsea]", Hislop said on the ESPN FC show. "It is my personality".
"And if I am here it is because in my career I have progressed like that".
Emery added: "I think today every player worked a lot, we continued our way and we know it's hard because the other teams in the top four are very strong".
The Gunners now sit fifth, a point off Manchester United in fourth.
The battle for Champions League qualification looks set to go to the wire, with a single point splitting United in fourth and Arsenal in sixth, although Chelsea have a game in hand.