Hello there! You can see my preferred technologies in the column below my photo. A simple web app for better management of homework. This rushed project is not usable anymore due to external API deprecation. I created this during first COVID lockdown in March , because at that time, our school IT system turned out to be completely unusable for student once there are more than a few assignments. A second iteration of the above.
Parsing the White House Press Briefings as HTML
GitHub - JonRinko/web-scraper-challenge
Background: I am a computer science teacher, with a strong interest in web development. I am proficient in many full-stack frameworks. Whether it be technical or educational, I know the importance of creating curriculum which is engaging, tested, and able to be used with a wide audience. Web Development: Web development is a growing passion for me, and something I do for fun regularly.
Applied Statistics & Probability
Skip to content. Instantly share code, notes, and snippets. Software Engineer. Sort: Recently created Sort options. Recently created Least recently created Recently updated Least recently updated.
Now that we can crawl some sites based on the previous posts , we need to persist the data somewhere where it can be retrieved and processed for analysis. In Scrapy, Item Pipelines are the prescribed mechanism by which scraped items can be persisted to a data store. In this post, we will be using a custom pipeline extension for MongoDB which we will further customize to check for duplicates. The code examples in this post build upon those in the previous examples.