Unless you got photogenic memory, having a no-mistake remembrance over something that you must see then call it back over can be pretty hard and rare. I guess the saying 'know you like the back of my hand' is also sort of accurate since you won't really ever get to know someone 100% for sure; you are simply just not them, therefore you'd only know them up to a certain extent or get a certain idea.