A caching plugin saves and HTML version of your website to reduce database requests and speed up your site. A CDN stores and serves your website assets (images, CSS, Javascript) to increase site speed and lower bandwidth usage. It’s not required to use either, but for the fastest website possible you should use both.