In this code we are fetching information from a job website named totaljobs about job listing available, filters them out according to skills and saves the output in a local file
This program is able to fetch the:
- Job Title/Role needed
- Company name
- location
- salary
As a data analyst I want to be able to get web large information in csv file.
Acceptance Criteria
- It is done when I can make a request to a specified url.
- It is done when I get response from that url.
- It is done when I get the target content from the url.
- It is done when that content is saved in csv file.
- BeautifulSoup
- requests
- csv file
- The only real difficulty was trying to locate the precise ID and passing robots elements (such as find element by ID, x-path, class, and find_all) that would appropriately transmit the information back.
- In overall our team was succussful to apply python on web scraping to complete our assignment.
- Fork this repository and navigate to the WebScraping-Data-Analytics folder
- Execute the program by running the pydatanalytics.py file using
$ python pydatanalytics.py - The program will then fetch the information and put the information into a csv file.