Nahki Wells also marked his return to the side with a goal – breaking the deadlock in first-half stoppage time, Dwight Gayle equalised on the hour mark before diminutive silenced the St James' Park faithful in the 82 minute
But what can Huddersfield Town take away from the result? Below Examiner's Football Writer Blake Welton assesses the victory.
1. David Wagner is a tactical genius
It was billed as the Rafa-volution vs the Wagner Revolution ahead of the game but it was the latter who won the tactical battle hands down.
The German Head Coach is quickly making a name for himself as a managerial maestro after a number of impressive summer signings and key in-game changing decisions.
Less than a year since his appointment, Wagner has revolutionised the ethos of Huddersfield Town as well as the personnel.
Under Chris Powell, the Terriers would have set-up for a draw at St James' Park – instead Wagner chose to play a bold and adventurous side which saw Nahki Wells return to the starting line-up.
The Bermudan forward repaid the faith with the opening goal in first-half stoppage time while Wagner's insightful substitutions once again provided a winning goal for the second successive weekend.
Without the ball Town were tight and compact, with it they were expansive and exciting with Newcastle United manager, Rafa Benitez, a former Champions League winner, being schooled by his younger counterpart.
2. Town's players have character
For the second league game running, Huddersfield Town bounced back from conceding a second-half equaliser to still go on and win the game.
After Dwight Gayle levelled for Newcastle United on the hour mark it seemed the home side would go on to win the game – dominating possession in front of 50,000-odd Geordies urging their side on.
But Town, marshaled by the impressive Christopher Schindler at the back, dug in and stayed resolute, providing the platform for Jack Payne to go on to grab the winner.
Among the boos from the home faithful at the final whistle, a few Newcastle fans stayed to applaud the Huddersfield Town players.
A nice gesture but they knew they were not only beaten by the better side but one with plenty of fight, passion and character – something the Black and White faithful would love to have among their ranks themselves.
3. There is strength in depth
David Wagner likes to stress the importance of having competition for places in the side and how every member of his squad is key – not just the starting 11.
And not only was this again underlined by Wagner's astute use of his substitutions during the game but also the fact there will soon be more selection headaches for the German with Dean Whitehead set to return from his three-match suspension against Aston Villa.
Throw in the fact Philip Billing and Harry Bunn are not too far off recovering from injury and Huddersfield Town are in a more than healthy position as the fixtures come thick and fast.
Obviously nothing is decided in August but points on the board with a squad looking more than capable of withstanding the rigours of a long, hard winter is no bad thing.
4. Big occasions don't faze them
St James' Park. Newcastle United. 50-odd thousand Geordies.
David Wagner's side dealt with the Saturday afternoon's occasion with consummate ease against the much-fancied Championship favourites.
Bring on Aston Villa on Tuesday night and hopefully another fantastic result.
5. Nahki Wells is a big player who scores big goals
It was great to see the Bermudian back in action for the Terriers and it had to be him who opened the scoring for Town didn't it?
He's a quality player who has the ability to score big goals on the big occasion – one of the reasons why a number of Championship rivals are believed to be interested in swooping for his signature.
His goal on his return from injury will do little to ward off those potential suitors as well as underlining his importance for Huddersfield Town but unless a massive financial package was put on the table why should the club, and Wells himself, contemplate parting company?
The start of the season has proven Huddersfield Town are a side on the up with Nahki potentially having a big part of it – so lets see him stay to enjoy the ride over the next nine months.