Yes, both ESXi versions are supported by vCenter Server 5.5 (see VMware Product Interoperability Matrixes). However, keep in mind that the VMs must not contain any settings which are not available with version 4.1 (e.g. a new hardware version ).
André