I mentioned in my previous blog post that I bought a Nvidia Jetson Orin Nano Super Developer Kit. Checkout my former post on Privacy and Edge Computing.
My motivation for buying the unit is getting hands on with the intricacies for Edge AI and local LLMs. Maybe finding a use case for it at home, but that’s is not mandatory.
I have learned that for exploring models, a good place to start is huggingface.co. I know that I would like to check out some of the european ones and compare to the ones i am using. I am currently both using
- Gemini
- ChatGPT
- Lumo
- Le Chat
So let’s see how close we can get with a local model.