After trying out many crappy, CHM viewers in Linux, I have finally settled on kchmviewer.
A real nice app to use actually.