Business
Jobs
  • About Us
  • Solutions
    • Job Postings
      Post your job and receive qualified candidates in 48h.
    • Candidate Assessments
      500+ technical and psychological tests, plus anti-fraud.
    • Headhunting
      Tailor-made executive search from start to finish.
    • Payroll + EOR
      Payroll dispersal and EOR across 15+ LATAM countries.
  • Pricing
  • Jobs

0

178
Views
How can I make JavaScript calls to scrape data from a website?

I'll try to explain everything the way I understand it as clearly as possible, so correct me if I'm confused with something.

I was trying to scrape the users from a member list on a website, I used Python and the first thing I did was making a post request to the Request URL with the required headers so I get a response that contains the data I need but this didn't work, so I tried to find out the reason.

From what I understand now the website uses AJAX to make XHR and JavaScript calls which respond with the content (users).

The JS code is stored on a static website from what Chrome's developer tool request initiators tell me (Here is an image for reference), which responds with the HTML that contains the users

The idea is to create a script that runs this static JS script that's stored online and fetch the data about the users from it. (Image for clarification)

How do I achieve this, I'm using python. What libraries do I need etc.? Any help/advice is greatly appreciated!

about 4 years ago · Juan Pablo Isaza
1 answers
Answer question

0

Based on your questions, I think you're trying to load data from a website that uses AJAX to load data.

In my opinion, have a look at Scray and some Headless Browers.

Check the flowing links for more information

  • https://scrapy.org/
  • https://github.com/puppeteer/puppeteer
  • https://github.com/pyppeteer/pyppeteer
about 4 years ago · Juan Pablo Isaza Report
Answer question
Find remote jobs

Discover the new way to find a job!

Top jobs
Top job categories
Business
Post vacancy Pricing Sales
Legal
Terms and conditions Privacy policy
© 2026 PeakU Inc. All Rights Reserved.
Andres GPT
Show me some job opportunities
There's an error!