This is cleared when you clear the history (Tools: Internet Options: Clear History).
It can be done manually, but some Antivirus type programs will clear it out for you when you restart the machine etc.
Other main reason these get cleared is when a teenage boy gets using the internet for some left handed surfing... Any possible culprits using the computer?