You can remember the meaning of 正义 with this easy mnemonic:
Justice (义) is not just avoiding wrong-doing but also involves taking positive actions and developing the right cultural values. Even if one wants to walk a straight (正) path, it's difficult if all roads are built curved.
Using mnemonics to remember the meaning of Chinese characters like can have an enormous impact on how long to learn Mandarin it takes.