Call `shrink_to_fit` when converting mutable arrays into immutable ones

[kylebarron]

Mutable arrays may have had reserve called, which reserves extra space in the vec. We should probably call Vec::shrink_to_fit before coercing into the immutable representation. Not sure if this is already getting called by arrow2 under the hood.