You can remember the meaning of 夫人 with this easy mnemonic:
A husband (夫) should man (人) up and take care of his lady at all times.
Using mnemonics to remember the meaning of Chinese characters like can have an enormous impact on how long to learn Mandarin it takes.