A 72-year-old South Korean man has been arrested in Japan for allegedly overstaying his tourist visa for more than 26 years, police said.