The obly smaller than notebook device that ever worked for me is the GPD Win Max 2023. The keyboard actually works and the performance is stellar. Of course the price is a while different matter but it doubles as a high performance gaming desktop especially with eGPU
Everything else so far looked great but was entirely impractical
Been running the docker on unraid for years in a HP slimline. Rock solid.
Yes the bigger model is quite good
Whisper is perfectly fine as a subtitle generator you can run at home and subtitle a movie in minutes
Game industry professional here: We know Riccitello. He presided over EA at critical transition periods and failed them. Under his tenure, Steam won total supremacy because he was trying to shift people to pay per install / slide your credit card to reload your gun. Yes his predecessor jumped the shark by publishing the Orange Box, but Riccitellos greed sealed the total failure of the largest company to deal with digital distribution by ignoring that gamers loved collecting boxes (something Valve understood and eventually turned into the massive Sale business where people buy many more games than they consume)
He presided over EA earlier than that too, and failed.
Both of times, he ended up getting sacked after the stock reached a record low. But personally he made out like a bandit selling EA his own investment in VG Holdings (Bioware/Pandemic) after becoming their CEO.
He’s the kind of CEO a board of directors would appoint to loot a company.
At unity, he invested into ads heavily and gambled on being able to become another landlord. He also probably paid good money on reputation management (search for Riccitello or even his full name on google and marvel at the results) after certain accusations were made.
cloudflare, 10 years. Prices are not going to not move for 10 years
Proxmox with alpine containers or Unraid are both painless
Jokes on you, it was written by airoboros. Seems good enough to fool a troll
I doubt someone who can’t google the price of macbook air can afford or even operate anything remotely useful in the LLM space.
I think at this point we are arguing belief.
I actually work with this stuff daily and there is a number of 30B models that are exceeding chatGPT for specific tasks such as coding or content generation, especially when enhanced with a lora.
airoboros-33b1gpt4-1.4.SuperHOT-8k for example comfortably outputs > 10 tokens/s on a 3090 and beats GPT-3.5 on writing stories, probably because it’s uncensored. It’s also got 8k context instead of 4.
Several recent LLama 2 based models exceed chatgpt on coding and classification tasks and are approaching GPT4 territory. Google bard has already been clobbered into a pulp.
The speed of advances is stunning.
M- architecture macs can run large LLMs via llama.cpp because of unified memory interface - in fact a recent macbook air with 64GB can comfortably run most models just fine. Even notebook AMD GPUs with shared memory have started running generative AI in the last week.
You can follow along at chat.lmsys.org. Open source LLMs are only a few months but have started encroaching on the proprietary leaders who have years of headstart
A 30B model which will be fine for specialized tasks runs on a 3090 or any modern mac today.
We are months away from being affordable at current trajectory
The trajectory is such that current L2 70B models are easily beating 3.5 and are approaching GPT4 performance - an A6000 can run them comfortably and this is a few months only after release.
Nah the trajectory is not in favor of proprietary, especially since they will have to dumb down due to alignment more and more
go cloudflare, renew for 10 years. nobrainer.
please the internet was great 10 years ago
Cost reduction in the field is orders of magnitude potential. Look at llama running on everything down to a raspy pi after 2 months.
There are massive gains to be made - once we have dedicated hardware for transformers, that’s orders of magnitude more.
See your phone being able to playback 24h of video but die after 3h of browsing? Dedicated hardware codec support
Exactly, how ever would we keep our own tribal community safe from people who want to learn /s
She’s an amazing engineer and inventor and was one of the best Chinese voices in the global tech community, consistently brining her own perspectives without holding back or letting herself be bullied. What a massive loss.
Counterpoint. You could launder all incoming content through an LLM running locally with the task to detoxify content. the technology cuts both ways.
Oh they are downright into extortion. Try asking them to delete your data and see what happens.
No they’ll train on laundered model output. Like every llama.
The investment thesis they the data is valuable is bonkers. It’s not. Not only has it been exfiltrated and can be laundered in a dozen ways, Reddit also won’t be able to effectively assert copyright.
Look at Facebook. It’s full of reposted quora content now with AI images and AI laundered text.
Reddit is dead