Do you have the Regular Labs Keyboard Shortcuts plugin installed?
If you have the Pro version of Keyboard Shortcuts, it will let you use a hotkey combination to trigger Cache Cleaner and clean the cache!
No matter where you are in your backend, from any page or view you will have a shortcut to clean your cache even faster.
The default hotkey combination for Cache Cleaner is SHIFT+CTRL+ALT+C (or SHIFT+⌘+ALT+C for Mac).