OK I propose any author who writes about an AI like it has thoughts should be immediately replaced with an AI. Time to sweep this shit out.

I mean, yes, there are AI companies, but if you want to be creative with AI these days, it’s actually not owned by the same few people. There are thousands of open source models that can be run on a midrange consumer GPU at home.

But most people who weren’t making art/music/code before weren’t making art/music/code because they weren’t interested in it. Having a tool that magically makes a bunch of shit you already didn’t have any interest in that barely rises above a vague novelty isn’t going to ever suddenly make someone interested in it.

The problem with AI is that every large company is using it to make search, information, and every product and tool worse because they are out of ideas, they actually believe(d?) that the AI was or could be sentient at some point, and, of course, promising AI would do X was a really good way to get through Q1 in 2024. And Q2, and Q3.

My 9th gen intel is still not the bottleneck of my 120hz 4K/AI rig, not by a longshot.

Yeah I got mind refurbished also, so someone else took the first hit on driving it off the lot (and waiting for it to be built). I guess they didn’t use it to its full extent though. That didn’t make it “cheap” though.

It’s sort of a niche within a niche and I appreciate your sharing some knowledge with me, thanks!

Hmm maybe in the new year I’ll try and update my process. I’m in the middle of a project though so it’s more about reliability than optimization. Thanks for the info though.

I usually run batches of 16 at 512x768 at most, doing more than that causes bottlenecks, but I feel like I was also able to do that on the 3070ti also. I’ll look into those other tools though when I’m home, thanks for the resources. (HF diffusers? I’m still using A1111)

(ETA: I have written a bunch of unreleased plugins to make A1111 work better for me, like VSCode-like editing for special symbols like (/[, and a bunch of other optimizations. I haven’t released them because they’re not “perfect” yet and I have other projects to be working on, but there’s reasons I haven’t left A1111)

I just run SD1.5 models, my process involves a lot of upscaling since things come out around 512 base size; I don’t really fuck with SDXL because generating at 1024 halves and halves again the number of images I can generate in any pass (and I have a lot of 1.5-based LORA models). I do really like SDXL’s general capabilities but I really rarely dip into that world (I feel like I locked in my process like 1.5 years ago and it works for me, don’t know what you kids are doing with your fancy pony diffusions 😃)

Oh I meant for image generation on a 4080, with LLM work I have the 64gb of the Mac available.

It fails whenever it exceeds the vram capacity, I’ve not been able to get it to spillover to the system.

Oh I didn’t mean “should cost $4000” just “would cost $4000”. I wish that the vram on video cards was modular, there’s so much ewaste generated by these bottlenecks.

Apple price gouges for memory, yes, but a 64gb theoretical 4090 would have cost as much in this market as the whole computer did. If you’re using it to its full capabilities then I think it’s one of the best values on the market. I just run the 20b models because they meet my needs (and in open webui I can combine a couple at that size), as I use the Mac for personal use also.

I’ll look into the Amd Strix though.

I know it’s a downvote earner on Lemmy but my 64gb M1 Max with its unified memory runs these large scale LLMs like a champ. My 4080 (which is ACHING for more VRAM) wishes it could. But when it comes to image generation, the 4080 smokes the Mac. The issue with image generation and VRAM size is you can think of the VRAM like an aperture, and the lesser VRAM closes off how much you can do in a single pass.

Sure thanks for finding a better link. Here’s a cookie. 🍪

Man I dunno if we’ve ever been here before. Nope.

yeah I did this almost 30 years ago and could recite it from scratch, haven’t made a cable since hs

and get on a list for using the national football league’s photographic assets without express written permission? facebanned

Not sure if that’s a quirk of your particular laptop but I’ve been using a thunderbolt to dual displayport adapter for years and it works great out of one port to drive a pair of 240hz 1440p displays.

LLMs are conversation engines (hopefully that’s not controversial).

Imagine if Google was a conversation engine instead of a search engine. You could enter your query and it would essentially describe, in conversation to you, the first search result. It would basically be like searching Google and using the “I’m feeling lucky” button all the time.

Google, even in its best days, would be a horrible search engine by the “I’m feeling lucky” standard, assuming you wanted an accurate result and accurate means “the system understood me and provided real information useful to me”. Google instead return(ed)s(?) millions or billions of results in response to your query, and we’ve become accustomed to finding what we want within the first 10 results back or, we tweak the search.

I don’t know if LLMs are really less accurate than a search engine from that standpoint. They “know” many things, but a lot of it needs to be verified. It might not be right on the first or 2nd pass. It might require tweaking your parameters to get better output. It has billions of parameters but regresses to some common mean.

If an LLM returned results back like a search engine instead of a conversation engine, I guess I mean it might return billions of results and probably most of them would be nonsense (but generally easily human-detectable) and you’d probably still get what you want within the first 10 results, or you’d tweak your parameters.

(Accordingly I don’t really see LLMs saving all that much practical time either since they can process data differently and parse requests differently but the need to verify their output means that this method still results in a lot of back and forth that we would have had before. It’s just different.)

(BTW this is exactly how Stable Diffusion and Midjourney work if you think of them as searching the latent space of the model and the prompt as the search query.)

edit: oh look, a troll appeared and immediately disappeared. nothing of value was lost.

Every corporation is destined to turn into some kind of deadbeat dad. They show up 8 years later because you find out they’ve been using your social security number to buy crypto.