I am new to web scraping and am trying to extract the usernames and scores of students on Kaggle. This is otherwise a lot of manual work, and we would like to automate the process. I am able to see the username at the end of the url of their icon. However, when I inspect the webpage, I’m not sure how to access each icon and each icon url.
Here is an example competition:
https://www.kaggle.com/competitions/digit-recognizer/leaderboard
If you hover over the icon of the third user, Andrej Marinchenko, you will see his username (andrej0marinchenko). It is also at the end of the hyperlink of the icon:
https://www.kaggle.com/andrej0marinchenko
In this example, the icon I describe is pointed to with a red arrow, and the score is pointed to with a blue arrow.
How do I scrape the webpage to get all the usernames and scores for all users? I apologize if I do not have the right tags and appreciate you letting me know.