The Priority Queue pattern is a pattern that allows us to prioritize requests sent to services so that higher priority requests are received and processed faster than lower priority requests.
This is useful for when we are building applications where we need to prioritize some clients over others, or if some requests need to be processed faster than usual for business/compliance reasons.
In this article, I'll talk about what the Priority Queue pattern is, what advantages priority queues can provide, what we need to consider when implementing the Priority Queue pattern and how can implement it priority queues in Azure (Spoiler alert, it's a little hacky!).
What is the Priority Queue pattern?
In our applications, we usually have services that will send requests to other services. When it comes to the cloud, we may send these requests to other services via a message broker. In many situations, the order that the requests are received by the consuming service isn't that important. However, there are some scenarios where we will need to process higher priority requests over lower priority requests.
This is where the Priority Queue pattern comes into play. This is where we will assign a priority to a message that we send to the message queue. Our publisher application can assign the priority, and then messages in the queue are automatically reordered so higher priority messages can be received and processed before those that have a lower priority.
However, in the Azure world, there isn't a service that natively supports automatic prioritization of messages. So to implement a priority queue pattern in Azure, we need an alternative.
Azure Service Bus topics support subscriptions that provide message filtering. So you could create a Service Bus topic that your producers can send messages to, and in the message metadata you can assign a priority to the message that can be filtered on. The message is then sent to the subscription for the consumer to read it.
Another option you could implement is to maintain separate queues for each message priority. This shifts the responsibility to your application to send the message to the right queue.
What advantages do priority queues give us?
Using the priority queue pattern can provide us with a couple of benefits. If you have business operations that have a higher priority over others, such as providing higher levels of performance to larger customers, than having a priority queue for those customers can help provide that.
If you use a single queue and assign priority to the message itself, you can reduce your operational costs by scaling down the number of consumers if you need to. If you have multiple queues, you can scale the number of consumers for lower priority queues down, and even stop processing low priority messages should your architecture allow that.
Having multiple message queues can also improve the performance of your application. You can partition your messages based on the priority that you assign. High priority messages can be processed immediately, and lower priority messages can be handled later.
What should we consider before implementing priority queues?
The priority of the message has a significant business impact, so priority should be framed in terms of business requirements. If a message has a high priority assigned to it, what does that mean to the business? Does that mean the message has to be processed in 10 seconds, 30 seconds, a minute?
Once you have an idea of what priority means from a business perspective, you can design how you're going to implement priority queues to support that.
Another thing you should consider when determining the priority levels of your messages is to determine how that affects the way your messages are processed. For example, should all high priority messages in the queue be processed before lower priority messages are processed? If so, you'll need to implement the priority queue pattern in such a way so that low priority messages will remain on the queue until all high priority messages are processed.
If you are required to process all messages (regardless of priority), then implementing separate queues for different priorities could be a good solution for this. This may introduce additional overhead from an operational standpoint, and shift the responsibility to your application to ensure that the message is sent to the right queue.
Conclusion
In this article, we discussed the Priority Queue pattern is, what advantages priority queues can provide, what we need to consider when implementing the Priority Queue pattern and how can implement it priority queues in Azure.
If you want to read more about this pattern, check out the following resources:
- Azure Architecture doc on the Priority Queue pattern
- What is Priority Queue | Introduction to Priority Queue on Geeks for Geeks
If you have any questions, feel free to reach out to me on X/Twitter @willvelida
Until next time, Happy coding! 🤓🖥️
Top comments (0)