To clean the fan, you will actually need to disassemble the laptop. Since it's a delicate operation, I would like to recommend you visit official HP Distributor or visit a laptop repair shop. They have the tools and knowledge to carefully disassemble the product.
It may be possible in some cases that, when overclocking is used, the software is guilty for causing FAN errors. If this is the case, try turning all options to default.