Honestly, you never know until you test it. The main concern I'd have is that it might be abrupt/jarring. Let's say, you imagine Morgan Freeman whose got a classic deep narration voice. We'll even throw in a photo of him for you to think of.
Let me tell you a story young man, about when I was just turning into a man. You see, all men go thru a phase where they naturally become aware and intense curious about the opposite sex. We all know it. We've all felt it. We've all been there. Well though, my friend Andy Duprey,
and he was a great friend, while in Prison meet the Twister sisters,
Unfortunately for poor Andy, they were more interested in the same sex than the opposite sex. That boy tried his hardest to fight them off every time but they took him regularly and violently, again and again.
Did it bother you when the story changed from being narrated by Morgan Freeman to pee wee herman?