I thought it was happening while reversing and just not resetting properly, so I disabled the feature in the Parking menu.
It was still happening so I took it to the dealer and they "reset the system".
Today during a long drive it happened again. I know it was fine when I started but about an hour in it was looking at the ground again.

I looked through the forums but it appears that most people have the opposite problem where it doesn't move the mirror at all.

I'm getting ready to take it back to the dealer again.
Anyone else had this happen or know a fix?

 

I've seen my mirror not return (intermittent) to the driving position from reverse. So, I'm thinking it's an electrical contact point somewhere that's the culprit. Good Luck...

 

Mine has failed to return to the drive setting. Unfortunately I don't notice it until I am driving and need to change lanes.

 

The dealer was unable to reproduce the issue and didn't find any fault codes.
I will try to pay more attention to when it happens but I'll have to live with it until it gets worse enough to happen regularly.

 

Kizik - Welcome to the Forum. When you are looking for advice or discussing a problem with your XK, it is very useful to identify the particular model and year that you are referring to. You will get more advice on the point this way. i.e. 2008 xkr convertible

 

Ah, I forgot to put that info my signature.
I have a 2008 XKR Portfolio coupe that I bought in October.