Such was the furore following the election in Smethwick in 1964 that the civil rights campaigner Malcolm X was moved to pay a visit.