We compared the prevalence and types of fractures in a clinical sample of 118 individuals diagnosed as children with infantile autism (IA) with 336 matched controls from the general population. All participants were screened through the nationwide Danish National Hospital Register. The average observation time was 30.3 years (range 27.3–30.4 years), and mean age at follow-up was 42.7 years (range 27.3–57.3 years). Of the 118 individuals with IA, 14 (11.9%) were registered with at least one fracture diagnosis against 83 (24.7%) in the comparison group (p = 0.004; OR = 0.41; 95%CI 0.22–0.76), but the nature of their fractures seems somewhat different. Epilepsy was a risk factor, but only in the comparison group. Our results lend no support to the notion that fracture is a common comorbid condition in a population of people diagnosed with IA as children.