You can remember the meaning of 以外 with this easy mnemonic:
According to (以) my mom, punishment means letting all the kids, apart from the naughty ones, play outside (外) in the morning. Little did she know that we used to all hate being outdoors when we were young.
Using mnemonics to remember the meaning of Chinese characters like can have an enormous impact on how long to learn Mandarin it takes.