You can remember the meaning of 那天 with this easy mnemonic:
On the day of the storm, we were visiting our Aunt that (那) day. The cloud gathered quickly and the sky (天) turned black suddenly.
Using mnemonics to remember the meaning of Chinese characters like can have an enormous impact on how long to learn Mandarin it takes.