Empresas
Empregos
  • Sobre nós
  • Soluções
    • Publicação de vagas
      Publique sua vaga e receba candidatos qualificados em 48h.
    • Avaliações de candidatos
      Mais de 500 testes técnicos e psicológicos, mais anti-fraude.
    • Headhunting
      Busca executiva personalizada do início ao fim.
    • Folha de Pagamento + EOR
      Dispersão de folha e EOR em mais de 15 países da LATAM.
  • Preços
  • Empregos

0

181
Visualizações
How can I make JavaScript calls to scrape data from a website?

I'll try to explain everything the way I understand it as clearly as possible, so correct me if I'm confused with something.

I was trying to scrape the users from a member list on a website, I used Python and the first thing I did was making a post request to the Request URL with the required headers so I get a response that contains the data I need but this didn't work, so I tried to find out the reason.

From what I understand now the website uses AJAX to make XHR and JavaScript calls which respond with the content (users).

The JS code is stored on a static website from what Chrome's developer tool request initiators tell me (Here is an image for reference), which responds with the HTML that contains the users

The idea is to create a script that runs this static JS script that's stored online and fetch the data about the users from it. (Image for clarification)

How do I achieve this, I'm using python. What libraries do I need etc.? Any help/advice is greatly appreciated!

about 4 years ago · Juan Pablo Isaza
1 Respostas
Responde à pergunta

0

Based on your questions, I think you're trying to load data from a website that uses AJAX to load data.

In my opinion, have a look at Scray and some Headless Browers.

Check the flowing links for more information

  • https://scrapy.org/
  • https://github.com/puppeteer/puppeteer
  • https://github.com/pyppeteer/pyppeteer
about 4 years ago · Juan Pablo Isaza Relatório
Responde à pergunta
Encontrar trabalhos remotos

Descubra a nova forma de encontrar um emprego!

melhores empregos
Principais categorias de trabalho
Empresas
Postar vaga Preços Comercial
Jurídico
Termos e Condições Política de privacidade
© 2026 PeakU Inc. All Rights Reserved.
Andres GPT
Recomende algumas ofertas para mim
Preciso de ajuda