Remembering words is different than remembering digits; mainly because remembering digits is actually remembering words that represent them ("five", for example). Therefore remembering digits would actually require you to remember 100 words instead of the current 20 which you then "decompress" into digits in your head using the simple decoding key.