uploads – Removing extra large generated images disables all crops

function filter_image_sizes( $sizes) {
    unset( $sizes('1536x1536')); // disable 2x medium-large size
    unset( $sizes('2048x2048')); // disable 2x large size
    return $sizes;
}
add_filter('intermediate_image_sizes_advanced', 'filter_image_sizes');

I check the uploads folder and only the original image is being added now. I check the docs and I don’t think I see it removing all the crops because of it.

Am I doing something wrong? When removing those sizes, do I need to add back the default sizes?