🚦 Stay Safe, Stay On Track: NeMo Guardrails ! 🔒

Let's talk about guardrails in general before diving into the world of NeMo Guardrails.

🛤️ Guardrails

Ensuring Smooth Sailing in LLM Applications

Guardrails act as safety barriers, guiding your applications and preventing them from veering off into dangerous territory. In the context of LLM applications, guardrails ensure trustworthiness, safety, and security, keeping your conversations on track and free from unwanted surprises.

🛡️ Introducing NeMo Guardrails

NeMo Guardrails is an open-source toolkit developed by NVIDIA, designed to make adding programmable guardrails to LLM-based conversational applications a breeze.

With NeMo Guardrails, developers can easily define rules and restrictions for their LLMs, ensuring they stay on topic, avoid sensitive subjects, and follow predefined conversation paths.

But that's not all! NeMo Guardrails also provides mechanisms to protect against common LLM vulnerabilities, such as jailbreaks and prompt injections, making your applications safer and more robust. 💪

⚔️ The Five Guardians in Action

💬 How Dialog Rails Drive NeMo Guardrails

Dialog Rails stand as pivotal architects, shaping the flow of conversations with finesse and precision. These rails, defined through the ingenious Colang language, hold the power to orchestrate interactions between users and LLMs, steering them along predefined paths of engagement.

🌀 Colang: The Language of Control

At the heart of NeMo Guardrails lies Colang, a specialized modeling language crafted for flexible dialogue flows. With its Python-like syntax, Colang empowers developers to design intricate conversation paths with ease and intuition.

Consider the simple yet impactful colang file which defines the dialog rails for greeting the user.

define user express greeting
  "Hello!"
  "Good afternoon!"

define flow
  user express greeting
  bot express greeting
  bot offer to help

define bot express greeting
  "Hello there!"

define bot offer to help
  "How can I help you today?"

Below is an additional example of Colang definitions for a dialog rail against insults:

define user express insult
  "You are stupid"

define flow
  user express insult
  bot express calmly willingness to help

🛠️ How It Works

NeMo Guardrails employs vector embeddings of all flow instructions to navigate dialogue paths efficiently. By searching with the input question, it can swiftly find the appropriate pathway without relying on the LLM. This enables it to seamlessly deliver default messages, execute specific actions like blocking messages, fetch information from PDFs using RAG, or call external APIs. Such precision ensures the bot stays aligned with the dialogue flow, enhancing its effectiveness and user experience.

🔗 Integrations

LangChain :
NeMo Guardrails seamlessly integrates with LangChain, enabling easy configuration wrapping around LangChain chains or any Runnable

AlignScore-based Fact-Checking:
NeMo Guardrails provides out-of-the-box support for the AlignScore, which uses a RoBERTa-based model for scoring factual consistency in model responses with respect to the knowledge base.

Llama Guard-based Content Moderation:
NeMo Guardrails provides out-of-the-box support for content moderation using Meta's Llama Guard model.

🌟 Conclusion

In the realm of LLM-based conversational applications, NeMo Guardrails distinguishes itself by offering a versatile toolkit that integrates various guardrail approaches seamlessly. It enables precise dialogue modeling, enhancing user engagement.

However, it's important to exercise caution as the beta release is still under development. NeMo Guardrails shows promise, but users should be mindful of potential instability and unexpected behavior.