Have a safeword with your grandparents. If anyone claims to be you, they have to know the safeword.

Aside, this isnt new, and doesnt require AI. You dont need to do fancy voice matching or anything special, just claim that the phone connection is bad.