There’s probably a bit of history behind it but, at this point the likely reason is that people just associate weightlifting (and heavy weights at that) with barbells and not dumbbells.