Linux CircleCI tests job takes a lot longer than necessary

This job rebuilds a lot of dependencies every time it runs. These could be cached, instead.