DEV Community

loading...

Discussion on: Scheduler Design Help Needed

Collapse
tusharborole profile image
Tushar Borole Author

I am a full-stack engineer, My Question is in terms of the backend infrastructure. So I am going to use the package called npmjs.com/package/html-differ to compare two HTML. There will be a user interface where the user will define the webpage URL and interval time where webpage changes will be checked. Let's assume we have 10k URL to check with different time intervals. I wanted to have a recommendation about the database or queuing system like rabbitmq i should use to make it scalable and fault tolerance.

Collapse
devdrake0 profile image
Si

You're asking an architectural question, which isn't easily answered without full context of what you're trying to make, what technologies/languages you want you use, or how much your budget is.

I'd also suggest text based communication isn't the right place for such an architectural design conversation.

Thread Thread
tusharborole profile image
Tushar Borole Author

I am creating an open-source project
Thanks for being so responsive and helping on this

Thread Thread
devdrake0 profile image
Si

Let me have a think of some questions that will help me understand your needs more, and maybe we can figure something out together 👍

Thread Thread
tusharborole profile image
Tushar Borole Author

Awesome, I havenot did any commit on this project, but if it do, it will be here github.com/tushariscoolster/Telesto