DEV Community

Omar Ajmi
Omar Ajmi

Posted on

Php scrapping web app

I am thinking about developing a scrapping web application using specifically PHP, but the internet say IT'S A SUICIDE MISSION, any thoughts?

Discussion (4)

Collapse
rhymes profile image
rhymes

What do they mean with "it's a suicide mission" ?

What are trying to do in particular?

Collapse
omarajmi profile image
Omar Ajmi Author • Edited on

they mean it’s a dead end and php never meant to scrape, what i am trying to do is a web app that helps freelancers gets the most probable and suitable job offers fir them, by scrapping specific freelancing sites, ofc its a profiling app and each user submits a survey about them selves so the app whould profile them.
so i love php and mastering it so i want to build this app with it, but the most people say it’s not meant to be

Collapse
rhymes profile image
rhymes

Ok they mean the project is a dead end, not the technology.

I don't know if it's a dead end, it's going to be very hard. Any project totally based on scraping requires a lot of maintenance. Every time a website changes your app will break.

There's also the fact that many freelance websites require registration to view the offers so those are not "scrapable".

Last but not least, you might infringe their copyright, check with every website.

Thread Thread
omarajmi profile image
Omar Ajmi Author

thanx man, thank you so much.