Hollweg was felled by Simon late in the third period Thursday night when the New York Islanders' forward angrily charged him and nailed him with a clothesline hit with his stick.
Simon was ejected, and Petr Prucha scored on the resulting long power play to lift the Rangers to a 2-1 win and a sweep of the home-and-home series between the local rivals.
"The best retaliation is to score on that power play," Hollweg said. "I couldn't feel any better than when that puck went in."
Hollweg stayed down on the ice for several minutes after the hit and was bleeding from the chin when he got up. He took a few stitches and had his face numbed but expects to play Saturday when the Rangers visit Pittsburgh.
"I feel good," he said. "We got the win. I kind of lost my hearing for a bit after it happened. I might've been out for a second or two. The pain goes away when you get those two points."
The hit was reminiscent of often-replayed clips of Marty McSorley's swinging stick shot to the head of Donald Brashear and Todd Bertuzzi's blindside punch against Steve Moore. Those both drew lengthy suspensions, and Simon could conceivably be shelved for the Islanders' remaining 15 regular-season games.
"I feel bad for taking a penalty that led to us losing the game," said Simon, who cut his remarks short. "I think I'll wait until I talk to the league office, and then I'll answer all questions afterward. I've always been known as a team guy, and I feel real bad about letting the team down."
Prucha smacked in a shot from the slot, off a feed from Michael Nylander with 5:14 left in the game and 1:17 into Simon's penalty.
The Islanders killed off the rest of the power play and thought they tied the game with 20.4 seconds left. Marc-Andre Bergeron's shot was stopped by Henrik Lundqvist and Trent Hunter slid the puck back to the goal line where Lundqvist barely swept it out.
After a lengthy video review, with fans chanting "Goal! Goal!" while accompanied by the organist, referee Kevin Pollack signaled no goal.
"I turned around and saw the puck just sliding toward the goal," Lundqvist said. "It's almost like slow motion. You try to get back with your stick. It's hard to see if it's a goal or not."
As tough as the save was, waiting for the ruling became excruciating to the helpless goalie.
"I looked up at the big TV there. Some replays it looked like a goal and some it looked like a save," Lundqvist said. "There was still 20 seconds left and they still had a big chance after that. It felt like the game was over almost but you have to get back in the game."
It was the second crucial call to go against the home team during an action-packed third period.
Hollweg drove Simon into the boards with a hard, clean check. Simon got up angrily and met Hollweg as they came together again. Hollweg fell to his back and rolled over onto his stomach by the boards.
"I just finished my check on the half wall," Hollweg said. "I think he was a little fazed by it. I turned around, and the next thing I knew he's winding up and hitting me in the face."
Simon, who gave the Islanders a 1-0 lead in the second period, was ejected -- slapped with a match penalty for deliberate attempt to injure.
"I didn't really have time to react to it," Hollweg said. "It's scary to your health but in the back of my mind I couldn't believe he did it."
Paul Mara scored a power-play goal for the Rangers to tie it in the middle period. The Rangers used a pair of 2-1 wins over their biggest rival to move into position for the final playoff spot in the Eastern Conference.
The Rangers are 4-0-1 in their past five games and have moved into an eighth-place tie in the Eastern Conference with 15 games left. The seventh-place Islanders are just three points ahead despite failing to earn a point for just the third time in 21 games (12-3-6).
"It's not easy to see a teammate lose his cool, and to have it happen with six minutes left in the game -- it's a tough one to swallow," said Brendan Witt, a hard-hitting Islanders defenseman. "We were undisciplined, and it cost us."
The Rangers also won 2-1 on Monday at Madison Square Garden but needed a shootout to beat Rick DiPietro, who made an Islanders-record 56 saves.
Both he and Lundqvist were stellar again, but for the second time in four nights Lundqvist -- the Rangers' second-year goalie -- was one save better. Lundqvist made 30 stops, DiPietro blocked 28.
Just like Monday, the Islanders struck first.
Richard Park carried the puck behind the Rangers net and passed it off to Arron Asham in the slot. The rugged forward wound up for a big drive that hit traffic in front and didn't get to Lundqvist. The puck bounded to Simon, who scored his 10th this season and fifth in eight games at 3:33 of the second period.
Mara tied it with his first with the Rangers just more than eight minutes later.
Matt Cullen won an offensive-zone faceoff back to Karel Rachunek, who moved the puck to his defensive partner at the right point. Mara, playing despite a shoulder injury sustained in Monday's win, loaded up for a shot that rocketed past DiPietro and flew back out at 11:54.
Rangers center Brandon Dubinsky, taking the place of injured forward Marcel Hossa, made his NHL debut. Hossa, who sprained a knee Monday against the Islanders, is expected to be out up to a month. ... The Islanders had their fifth home sellout of the season, including both meetings with the Rangers, who will visit twice more.