I have an Express API which serves data to a frontend, and have several integrations to an ERP system. One of the integration is very limited so we decided to save remote data in our databases to be able to manage it as we need. Bring all this information is a daily task (every 24h) and consists on fetch a CSV file from the remote ERP, read, stream, transform and upsert data. First load is about 200k rows and then smaller daily chunks with only updates/new data. This job is very resource-intensive during ~40seconds for the whole load and then its 300 rows by day as most.

Is it a good use-case to move this logic into a distributed worker like using queues?

Thanks.