The most common strategy to enhance the plasticity of metallic glasses (MGs) is to synthesize MG composites with crystalline phases. Here, the evolution of crystallization and the correlation between void-like defects and crystallization for the as-spun and cryogenically-treated (CT) MGs are investigated under a rigorous annealing process conducted in-situ. The as-spun specimen maintains its amorphous structure with a relatively large size of nanoscale defects. However, crystallization is observed for the CT MG with a high concentration of nanoscale defects that decreases during the crystallization process. The crystallization develops readily in the CT MG due to the greater size of the ordered clusters, the higher concentration of seeding sites, and its greater nucleation rate. Our findings demonstrated cryogenic treatment could tune atomic rearrangements, which has guiding significance on designing MG composite with controlled length scales and distribution of crystalline inclusions.