The easiest way to clean up Closeby code that was installed in your theme is by going to your Shopify theme and selecting "Edit Code".
Search "closeby" to see the files leftover in your code and simply delete them by clicking the trash icon. That's it!