Every Silver Has A Cloudy Lining? Finding Familiar Faces!