Hey I am working on a scraping project to scrape google search results, but I can't found the way how to scrape the related results with their respective result :
This image shows the related result bolow SerpApi - GitHub
I want the result in this format :
{
"position": 2,
"title": "SerpApi - GitHub",
"link": "https://github.com/serpapi",
"displayed_link": "https://github.com › serpapi",
"thumbnail": "https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcTafCQTO0unWWglFkuLJV72Vkezw2pEFbbyJf4kuXTkDaoqAu5vZdpD&usqp=CAE&s",
"snippet": "API to get search engine results with ease. SerpApi has 45 repositories available. Follow their code on GitHub.",
"related_results": [
{
"position": 1,
"title": "GitHub - serpapi/google-search-results-python",
"link": "https://github.com/serpapi/google-search-results-python",
"displayed_link": "https://github.com › serpapi › google-search-results-pyt...",
"snippet": "This Python package is meant to scrape and parse search results from Google, Bing, Baidu, Yandex, Yahoo, Home depot, Ebay and more.. using SerpApi.",
}
]
}
Currently I am only able to target organic results like this :
$(".tF2Cxc ,.kWxLod ").each((i, el) => {
organicResults[i] = ({
title: $(el).find(".yuRUbf h3").text(),
link:$(el).find("div.yuRUbf a").attr("href"),
displayed_link:$(el).find(".yuRUbf .NJjxre").text(),
snippet: $(el).find(".VwiC3b").text()
})
})
which gives me only this part :
{
"title": "SerpApi - GitHub",
"link": "https://github.com/serpapi",
"displayed_link": "https://github.com › serpapi",
"snippet": "API to get search engine results with ease. SerpApi has 45 repositories available. Follow their code on GitHub.",
}
How can I add related_results to this organic result ?
Note: I am using cheerio to parse html here.