The next step will be extracting the full text of each job post given by the spider. Many of the posts are hosted on Indeed which should be fairly easy to extract out but other sites will have unique HTML tags and such. So we will need to have scripts for extracting different site text depending on the domain it's hosted on.