Fixes a bug where a cached tokenizer/model was not accessible anymore offline (either forcing offline mode or because of an internet issue).

• More tests for regression in cached non existence by @sgugger in #19216
• Fix cached_file in offline mode for cached non-existing files by @sgugger in #19206
• Don't warn of move if cache is empty by @sgugger in #19109