Common Projects
Web scraping is super useful if you’re making an app that uses live data from the web. Common examples of live data include product info, stock prices, and sports stats. Here are some examples of projects that utilized webscraping:
Ikea Interior Design Tool https://youtu.be/6F5dhiUhRIs
Recipe Recommendation https://youtu.be/h0BVNLC_A4g
Stock Market Simulator https://www.youtube.com/watch?v=6S1TPsxJm-o&feature=youtu.be
NBA Trade Machine https://www.youtube.com/watch?v=cF1kbkXGS60&feature=youtu.be
Note on API's
If you’re thinking of using web scraping in your project, you should first check if the data you want is available through an API.
API stands for Application Programming Interface which is basically a set of functions the data provider has created and provided for you to use. For example, Twitter provides an API that lets you access tweet data such as tweets by a certain person or during a certain timeframe. Other common API's include Google Maps, Google Cloud, Yelp.
Certain webscraping operations can be work-intensive without API's, so you should use an API whenever possible.