So no, there is not "nothing we can do" about the ISP, but the big actors (nation agencies) are indeed able to break into your computer, just like a swat team is able to break into your home.