The proportion of Black and Hispanic students enrolled in Harvard College’s freshman class dropped in the second year after the Supreme Court overturned race-conscious undergraduate admissions, according to data released by Harvard on Thursday.

After decades of gradual growth, the number of Black students enrolling at many elite colleges has dropped in the two years since the Supreme Court banned affirmative action in admissions, leaving so...