You can remember the meaning of 害怕 with this easy mnemonic:
There is a rumour that the Pa Pa next door was a gang member. He does no harm (害) now but people are still afraid (怕).
Using mnemonics to remember the meaning of Chinese characters like can have an enormous impact on how long to learn Mandarin it takes.