A big part of it is fear of change and fear of something new. And in a way i get that. Mix in a bit of newspaper hysteria and the usual comments that seem to get passed around (every non-EV owner seems to "know" the batteries only last 5 years and then need replaced for £93938882)
If i gave my mother in law my Range Rover, and asked her to fill up the LPG tank... She probably wouldn't manage it. Most folk would struggle on the first go i recon. Its fiddly and awkward and some portion of the time doesnt work right. I've had the car years and even now i still find it fiddly at times. And thats just a slight modification to the normal fuelling-up process. LPG didnt catch on in the 90's/00's and i can see exactly why. The fuelling process is crap, and the conversions almost always had poor range. All sounds a bit familiar really!! Now imagine those same folk trying to operate a rapid charger... They're not the best with tech anyway, apps and cards and stuff? Nope.
I got my mum to drop me at the airport when i had the previous EV and mum drove the car back to her house. She was literally terrified of it to begin with, but she managed to drive it home without issue (i let her drive TO the airport so she got a feel for it while i was there). I suggested she might want to plug it in and charge it up, and said to use it as she liked while we were away. She didnt charge it because "wires" (i'd left the granny plug in the boot) and didnt drive it at all for the 2+ weeks i was away. My brother ended up going over and taking the car to a nearby rapid to charge it up the day we were arriving home so it actually had sufficient range to get us home again.
So yeah, i can understand it. Fear of change, mixed in with lots of BS, and some actual real concerns such as available range, charging issues and cost, and a very real chance of being inconvenienced by it.
I try to correct people, but i often find, despite being an EV owner, that people dont actually seem to believe you when you tell them it charges in 7 hours while i'm asleep, or in 30mins at a rapid or whatever other falsehood. You get a sort of "oh yea?" but with a layer of incredulity...