I’ve been playing with SiteSpeed Insights from Google and based on the advice received, updated a few things on this site to speed it up.
In addition to Cloudflare and Jetpack caching, I also turned on lazy image loading from Jetpack, which doesn’t load images further down on the page until you scroll. It improved my score some but the difference in speed is noticeable to me.
I’ll have to spend more time digging into the recommendations but it seems pretty clear that you can’t wing it anymore. Fortunately there are lots of tools available for WordPress sites.