Are you sure you mean ICRF? ICRF is centered on solar system barycenter, so it may
explain the difference. The inertial frame aligned with ICRF and centered about Earth center
is GCRF. GCRF is indeed close to EME2000 (a few tens of arcseconds constant angular bias).