I'm Jake Cahill. Lifetime Pythonista, web scraping and automation expert. Enjoy books. Love my wife, dog, and cat, and think AI and Julia are pretty nifty
Location
Maine, USA
Education
A Master's patient mentorship and insatiable curiosity
Thank you! I'm going to need it. By the end of the week I hope to have two base docker images built. One will contain my Pydra web crawler in all its glory, with all of the custom filter defenses I've developed over the years so that no website owner will need to add special exceptions to allow my bot past their filters. Pydra is capable of fooling any filter I've thrown it at so far. The other will contain what will be needed for processing of media files and a Flask email route. Both images will be based on an Alpine image with Python 3.6+ with relevant packages, minified as much as possible for performance.
Next week will involve the building of a node image for use with a Gatsby front end, and an Nginx image as a web server and reverse proxy. Performance is key for this application. I want speed to be paramount and am considering using Pypy rather than Python 3.6 but have yet to benchmark the performance in this particular application between the two.
For further actions, you may consider blocking this person and/or reporting abuse
We're a place where coders share, stay up-to-date and grow their careers.
Good luck!!! What do you hope to accomplish by the end of this week?
Thank you! I'm going to need it. By the end of the week I hope to have two base docker images built. One will contain my Pydra web crawler in all its glory, with all of the custom filter defenses I've developed over the years so that no website owner will need to add special exceptions to allow my bot past their filters. Pydra is capable of fooling any filter I've thrown it at so far. The other will contain what will be needed for processing of media files and a Flask email route. Both images will be based on an Alpine image with Python 3.6+ with relevant packages, minified as much as possible for performance.
Next week will involve the building of a node image for use with a Gatsby front end, and an Nginx image as a web server and reverse proxy. Performance is key for this application. I want speed to be paramount and am considering using Pypy rather than Python 3.6 but have yet to benchmark the performance in this particular application between the two.