I have been online for 24 years. Net neutrality rules have only been in place in the US since 2015. Attempts by ISPs to throttle or otherwise mess with their customers' online experience over the years have been met with lawsuits and the government has generally sided with customers. Since 2015, I've noticed less competition (i.e. there are fewer options for internet in many areas). People I know in rural areas have actually lost home internet access and have to drive a half hour into town or more to use libraries or free wifi at local businesses. I don't think you have a lot to worry about.
In other words, the Internet did just fine for the 46 years before net neutrality rules were in place. I think it'll be fine with the rollback.