Global AI and Data Science

 View Only
Expand all | Collapse all

Good sources about advanced scraping?

  • 1.  Good sources about advanced scraping?

    Posted Tue April 26, 2022 10:04 AM

    Hello

    I build many scraping based on node + puppeteer + PostgreSQL as data storage and queue.

    Everything works great, but I want to develop myself, my next goal to scraping data from + 100 000 000 pages (I have my proxy server with squid). When I can find sources to learn advanced scraping data, optimize performance, etc?

    what would you recommend to me?



    ------------------------------
    mxcd mxcdh
    ------------------------------

    #GlobalAIandDataScience
    #GlobalDataScience