You can remember the meaning of 私人 with this easy mnemonic:
He is a very private (私) man (人), I don't think he'll want you walking through his yard.
Using mnemonics to remember the meaning of Chinese characters like can have an enormous impact on how long to learn Mandarin it takes.