towards the treatment of 30 million pieces of data to later see them reflected in a dashboard in power BI