At a glance
The dominant Edinburgh side surged eight points clear of Celtic at the summit of the Scottish Premiership to bolster their early championship claims and worsen the malaise around the Celtic team.
A superb goal from Kyziridis and a spot-kick from Shankland gave the Hearts team a two-goal advantage that the reigning champions could not overcome.
Dane Murray - among three youth players in the Celtic starting lineup - scored an own goal early on to put the home side ahead at a energetic Tynecastle, and it was the youngster's infringement that led to the penalty.
A stylish finish from McGregor of the season had swiftly equalized Hearts' opener, and Benjamin Nygren almost put Rodgers' team in front, choosing placement over power and allowing the Hearts keeper to make a crucial stop.
But the unstoppable Hearts side seized control again to consign the visitors to successive league defeats for the initial occasion since last year.
It also gives the Hearts a significant lead at the summit.
The last time they were this far ahead was in 2005-06 under their former manager, when they ultimately finished second - one of just four occasions that a team has not secured the title having held such a lead in the last three decades.
McInnes, whose Aberdeen side were second to Celtic on multiple times, has been working hard to downplay championship discussions, as the club seek their maiden league title since 1960.
The Celtic boss has experienced this previously at Celtic - both flawless and stuttering starts to a season. He's never ended as runner-up.
But on Sunday's evidence, this Hearts team showed they need to be taken seriously.
Hearts started with the confidence of a side undefeated in the league this season - the popular attacker delivered a ball for Shankland to stab wide.
Celtic didn't help themselves with some uncharacteristic carelessness in possession and they buckled under their initial test.
Claudio Braga's header was touched on to a post by Kasper Schmeichel and the follow-up from Shankland was turned into the net by the unfortunate Murray, in for the absent center-back.
Celtic grew into the contest and started stringing passes together. From one such move, the midfielder released Tierney to set up McGregor, who rolled in.
Apart from the Nygren chance, the visitors struggled to create much for striker Kenny or his replacement Shin Yamada amid the absence of stricken attackers Kelechi Iheanacho and Daizen Maeda.
Hearts rediscovered their energy and versatility in attacking from across the final third. Kyziridis, one of the finds of the club's scouting network, struck low past the goalkeeper from the just outside the area.
Almost straight away, the defender tripped the midfielder in the right side of the box and the penalty taker scored. And it could've been an even more handsome win, had substitute Ageu not been denied by the shot-stopper.
The visitors' performance after the break was partially encapsulated in a couple of moments involving big-money recruit Engles.
The set-piece from Engles delivery was in stark contrast to his European display in the continental victory over Sturm Graz and the national team player was then booked for a cynical foul.
The Hearts manager: "The effort from the squad is evident, the team spirit. That's not always enough to win games week in, week out.
"What we have got, is skillful players. You're seeing that from multiple individuals who have been here previously. Some of the new signings are keen to demonstrate their quality.
"We're in a positive moment at the minute, but it's just one win. It's crucial for us to keep winning. We've got much work ahead, loads to do. After the first two rounds is normally an indication of where you are."
The Celtic boss: "It's a really poor goal from our perspective. We failed to push up when the ball went back as a line so when they play it, they should have players offside but weren't. We have got to improve with the attempt.
"Plenty of matches to play for. It's only the beginning. It's only nine games in. Obviously, being eight adrift is not what we would want. The positive is there's numerous fixtures to play.
"We now have to focus on the present and look to find more consistency and more quality in our play."
The Glasgow club are back at home on midweek against promoted side Falkirk (19:45 GMT). At the same time in the top division, Hearts are at their opponents' ground.
A seasoned gaming analyst with over a decade of experience in online casino reviews and strategy development.