Although the visual cortex is huge and takes up a large amount of brain resources, there is a special part of the brain outside of the visual cortex whose role it is to recognize faces. It’s called the fusiform face area, or FFA (Kanwisher, 1997). This special part of the brain is also near the amygdala, which is the emotional center of the brain. This means that faces grab attention, are recognized quickly, and bypass the usual brain interpreting channels.

https://www.blog.theteamw.com/2011/03/27/100-things-you-should-know-about-people-92-there-is-a-brain-area-dedicated-to-perceiving-faces/