Catching up this morning on all the OpenAI and Microsoft news. Hard to overstate how dramatic a weekend this was for the tech world. As a (small) OpenAI customer, I’m not sure where this leaves me. One thing is clear: Satya Nadella is a really impactful CEO. He turned a crisis into a triumph.
Gannon Burgett very curious to see how this all plays out, but it really was/is a top tier move from MSFT.
Timo Koola isn’t this just a short-term fix for Nadella? Whatever lead to this drama has a potential to cause him serious trouble later?
Manton Reece @tkoola Maybe. In theory this sets the foundation for a lot more in-house AI work for Microsoft, if everything pans out. Meanwhile the OpenAI partnership continues along for the short term.
cshotton @manton If I were you, I'd skip worrying at all about OpenAI. Go get a copy of LM Studio, pull down one of the Mistral LLMs from HuggingFace, and never look back. OpenAI was dead in the water before it started. The Open Source LLM scene is going to eat their lunch in not too long.
Manton Reece @cshotton I should play with that. I don’t think I want to run my own AI stuff, though, at least not yet. Because of the processing power needed it’s such a nice thing to outsource.
cshotton @manton I have a pretty vanilla Mac Studio M1 and it runs these things fine. LM Studio replicates almost all of the OpenAI APIs and runs all of the Llama-derived LLMs as if you are talking to ChatGPT 3.5 or 4. The only missing piece at the moment is function callbacks. You'd be amazed at how well a 4 GB model like Mistral 7B does running locally. It takes about 5 minutes to get it all going. Give it a try! https://lmstudio.ai/
