I just wanted to confirm from our meeting just now, did you want me to (some crazy shit that could cause problems)?

  • 71 Posts
  • 490 Comments
Joined 6 months ago
cake
Cake day: January 9th, 2024

help-circle


  • GPT4all can do it pretty easily on a desktop with a good GPU. I think it’s unlikely that anything can run locally on your phone (LLMs are notably hogs in terms of even pretty capable desktop PC resources; there’s just not a cheap way to do them). You could use colab or something via your phone, and there is probably a little howto guide somewhere that shows how to do a Mistral setup on colab. It’ll take some technical skill though.

    You might just bite the bullet and do $20/mo for the GPT-4 subscription also. It can also do web searches, I think, although in practice it’s pretty clunky the times it’s tried to do things like that for me. I’m not aware of one that does the “search the web for answers and get back to me” thing really all that perfectly or smoothly I’m sad to say.


  • GPT-4 is apparently the model to beat. I haven’t seen all that much difference in practice between GPT-4 and 4o. I’ve heard various claims about various other models outperforming it (notably including Claude) but I haven’t seen the claims materialize over the long haul as yet.

    I have however heard that Mistral can get quite close to GPT-4, run for free locally with the right hardware, if you build up a hand curated set of around 100 query/response pairs from GPT-4 that are what you want it to do, and then fine-tune Mistral against that training set. I haven’t tried it but that’s what I’ve heard.









  • “Let’s just divide up Poland and keep the peace. We can focus our whole energy on the western front, you can save yourselves bloodshed by the tanker load, and in a few short years we can share dominion over a subjugated world.”

    “You so right, that sounds like a great plan”

    “Hey guess what I just decided”

    The whole world would have been different. It was still a pretty close thing with help from the Soviets and with Germany fighting a ludicrous two-front war for literally no military or geopolitical reason at all.




  • Forgiveness answer: At least for me, hearing someone speak in a foreign language near me if I’m trying to do something is like Kryptonite for my concentration. I basically just have to leave and go somewhere else, or else abandon the idea of getting something done until it stops. It’s just impossible for my brain to not pay attention to it. I don’t think I would ever blame it on the person who’s just trying to have a conversation, and if I’m just standing in line or something it doesn’t bother me, but I do understand how it can be irritating.

    Probably more realistic answer: Because living in America leads to a spiraling hell of stress and unhappiness, and so if you’re an asshole, and some innocent person presents themselves that you can take it all out on for literally any made up reason at all, then it’s go time. Also explains a lot of taking it out on customer service people for literally no reason at all.