I'm trying to fetch a content of a page. When I inspect and go under the 'Elements' section, I can see the needed data in span tag for example, but when I try to fetch which I do as a get request to the url, I receive different HTML that doesn't contain the same data but less.
This is how I try to fetch my data
async function fetchData(url) {
const response = await axios.get(url);
console.log(response.data)
}
What would be the reason of the difference and how could I solve it?
Should I use different technique?
Well, indeed, crawlers are supposed to use parsing tools, like Puppeteer library or Cheerio for data-grabbing.
Here are some references:
I've tried to do something like that a few times ago. If you're having troubles - ask for help