CodeDevils Scraper
CD-Scraper is a project designed to teach the fundamentals of web scaping and the tools to make that happen. The goal is to design a system for scraping job posting from various websites and serving the collected data through an API build using SpringBoot. As this project is going to be based fully in Java, it is friendly to those that are just starting off their programming journey.
Throughout this project, contributors will have the opportunity to collaborate with peers, share insights, and learn from each other. This team-oriented approach fosters a supportive environment where beginners can ask questions and gain confidence in their coding abilities. You'll not only develop your technical skills but also engage in problem-solving and critical thinking as you navigate the challenges of web scraping together.
Each contributor will be responsible for implementing a script to scrape different job posting websites (i.e. Indeed, LinkedIn). Through this process, you will, hopefully, have a grasp on the some fundamental HTML parsing.
In this project, you will NOT be working with APIs or any web related technology. Those will be managed by staff to ensure this project is easy to pick up for those new to programming, but wanting to contribute to a more complex project outside of school assignments. Also, you will NOT be working with any data and their persistence (i.e. databases).
If you want to apply what you have learned about Java in class into a project that is more tangible, join our beginner-friendly project by filling out our application. Your project lead will reach out to you within the week. Let's learn to code by building something meaningful and fun!
Current Project Goals
- Learn about web scraping
- Take Java skills from school and implement them into a tangible project
- Gain confidence to start your own personal projects
Project Team
Frank Lin
I am a full-stack developer who has an endless curiosity for web development and AI. I am on a constant journey of learning and breaking things. Oh, and I am also the President of CodeDevils.
Logan Wright
Carter Hollman
Derrick Berko
Michael Ellmer