This does depend on if it's the actual gasket for the pump housing or what we call the mechanical seal. Neither one requires that the engine be dropped to replace.
If it's the gasket around the pump itself I'd imagine that would prevent the cooling system from building up presure and could cause it to run hot.