This is a submission for the Cloudflare AI Challenge.
ChatGPT AI chat model with Llama2, Workers AI Model, Hono.js and Wranger.
What I Built
A ChatGPT app using llama-2-7b-chat-int8 model from Cloudflare. Implemented with Worker AI, Hono.js
Demo
Features:
- History panel
- Content Streaming
- New Chat functionality
GitHub Code
Implementation
This app is built to function exactly like ChatGPT. You can ask questions and the app will generate a stream response. It has a history panel to track previous prompts, which is useful for tracking what you entered.
I used the following tools to accomplish this task.
Top comments (2)
Hey Guys. Since I dropped this project last night. people have been asking me how I built it. Will you guys be open to reading a blog post on this project? That is how to build it yourself and deploy it.
Let me know by dropping a comment with your favorite emoji and I will make a blog post on it.
Thanks.
Yes, would be interesting to know how (and why) you came up to Hono and what are your thoughts about that. I also look into using this framework for one of my projects 🦾