Yes, the same thing is going on for me. I have already upgraded my hosting plan and tried 4 cache plugins (I stayed for Super Cache because the other ones broke my theme) but it is still slow. I get 4 points for mobile and 32 for desktop in PageSpeed Insights.
