As you suspect, the key shouldn't mean much as to keep their memory, most radios have a direct connection that is always hot. It's either directly to the battery or from behind the dash. Your diagnosis of a loose or corroded connection is appropriate.
A vom meter will help you find it but you...