Grading Webscraping Projects

  • Effectively using BeautifulSoup and requests requires a relatively high-level understanding of the web, and specifically, how pages are rendered inside the browser. Because this is something we never covered in class, there is significant time needed to learn this, and thus should be taken into account.

  • Installing the modules does not take long and is relatively pain-free, and once you have an understanding of how pages are displayed, its relatively simple to play around with the module, as the documentation is solid.

  • If a project uses external API's, like Google Maps, or Yelp, this needs to be taken into account as well, since these external API's have many constraints, such as a limit to the amount of calls you can make, that need to be worked around. Also note that API's can do some of the heavy lifting.

results matching ""

    No results matching ""