When Human Universal Meets Language Specific