Like most apps and websites, Google Drive has a cache of data it uses to quickly load information you've accessed recently.
It's easy to delete files on your Chromebook, but you should probably back them up to Google Drive first.