- I don't want to make myself dependant on a company from a foreign nation if I can help it.
- I want to keep the ability to use my own brain, especially given that they still are massively undercharging. So once they would start to charge the real price and my brain is gone I would have no choice and it would ruin me (I don't make that much money).
- I am very suspicious about the legal situation. How is it legal to generate software based on other software while not adhering to any license agreement? Don't say "fair use", the American government made sure that doesn't exist outside of the USA.
- I'm not your grandma.
And for outside of programming where you can't easily recognize when something is hallucinated accuracy is a huge issue. When I use Google its AI answers are often complete nonsense. I usually ignore them. Only sometimes notice the nonsense.
How do you decide when the cache-hit savings are worth riding out a degrading route versus eating the cold start on a healthy one?
[flagged]
Personally I don't use LLMs, so I wonder what this kind of router is good for? Why not just a library?
You don't use LLMs? Even my grandma use LLMs, what's your reasons?
- I don't like to burn down the planet.
- I don't want to make myself dependant on a company from a foreign nation if I can help it.
- I want to keep the ability to use my own brain, especially given that they still are massively undercharging. So once they would start to charge the real price and my brain is gone I would have no choice and it would ruin me (I don't make that much money).
- I am very suspicious about the legal situation. How is it legal to generate software based on other software while not adhering to any license agreement? Don't say "fair use", the American government made sure that doesn't exist outside of the USA.
- I'm not your grandma.
And for outside of programming where you can't easily recognize when something is hallucinated accuracy is a huge issue. When I use Google its AI answers are often complete nonsense. I usually ignore them. Only sometimes notice the nonsense.
thank you! i find this very interesting, especially the Cache-aware concurrency .
No worries! Thank you for checking it out. The cache-aware concurrency was a ton of fun to implement
another option for on-device routers is role-model that i'm building: https://github.com/try-works/role-model
[dead]
[flagged]
[dead]