Amazing starting point to go into production, hassle free! Could you start RAG Chatbot with any of the Foundational model (open source LLM) ? just curious to know how this will fit into the structure ! and what would be the bottle neck issues ?
If you mean LLMs, what I typically do is put the API client inside the LLM providers. I usually deploy the custom LLM in its own container / infrrence server, using vLLM.
I would be interested to know, how to structure the project without cookie-cutter ( dev project structure agnostic to cookie cutter).In other words, the project changes, but principal of structuring project would remain same.
This is impressive! Though it may seem opinionated scaffolding, it is indeed well thought through and very practical to get ball rolling. Bonus: it is laid out with production deployment elements in mind from get go. Bravo! 👏
A reasoning Multi Agent System. Isn't this the Holy Grail for every sentient person?
Hahaha you are really into philosophy, right? 🤣
Sort of. I completed a PhD in Psychology.
A reasoning multi-agent system will be great!
Amazing starting point to go into production, hassle free! Could you start RAG Chatbot with any of the Foundational model (open source LLM) ? just curious to know how this will fit into the structure ! and what would be the bottle neck issues ?
Sure, I like that idea 🙌
first of all, thank you.
RAG Chatbot
Thanks to you for the support! I think the RAG chatbot is a good option to begin with 💪
How do you integrate production ML models with this?
If you mean LLMs, what I typically do is put the API client inside the LLM providers. I usually deploy the custom LLM in its own container / infrrence server, using vLLM.
ty man 👍
I would be interested to know, how to structure the project without cookie-cutter ( dev project structure agnostic to cookie cutter).In other words, the project changes, but principal of structuring project would remain same.
what do you mean? Like starting everything from scratch, without the cookiecutter?
I agree, it is self explanatory. I would be interested to know how to develop the project in which order.
ah, right! I understand. Sure, I can cover that for future videos / posts!
Not from scratch, I mean what should be the intuition of structuring the project if starting from scratch for any project in AI.
🤩🙌
🙌 🙌 🙌
RAG Chatbot
thanks for answering!
A reasoning multi agent system
thanks for the answer!
Thank you very much for everything. Your projects and efforts are contributing very positively to all my projects. Whenever I can, I recommend you.
Multi-Agent System.
thanks!! I really appreciate that :)
This is impressive! Though it may seem opinionated scaffolding, it is indeed well thought through and very practical to get ball rolling. Bonus: it is laid out with production deployment elements in mind from get go. Bravo! 👏