Why was the reason Chuck first left HHM brushed over so fast?

Feels strange that this wasn't brought up more, especially when Chuck is so mad at Jimmy for the Chicago Sunroof incident...