Latest local AI models Personaplex

What is good folks welcome ya boy back to the digital trenches where we actually build stuff instead of just looking at charts all day.

So I finally sat down and got this Personaplex thing running locally and I have to say I am actually impressed for once usually these new AI wrappers are just total garbage or hype cycles but this full duplex model is different it feels like actual conversation because it can handle the back and forth without that awkward pause like you are talking to a robot from the 90s it responds in real time and that opens up some crazy doors for automation.

I am seriously looking into getting my Jarvis on and hooking this thing up to the rest of my home lab infrastructure imagine just yelling at the ceiling to deploy a container or check the server stats and it actually talks back with attitude that is the dream right there but we have to talk about the reality of running this beast because it ain't cheap and it ain't easy.

The barrier to entry on this stuff is getting ridiculous honestly you practically need a dedicated power plant and a server rack just to say hello to a computer unfortunately this is out of reach for many regular people because if you want to run the model locally without relying on some cloud API that spies on you then you need VRAM lots of it.

d67e7b88-5f31-40ab-bf95-cc1f061b8dd5.jpg
An Image I generated with AI

I am running a 3090 right now and it barely keeps up I managed to load the model but that is it the card is maxed out completely screaming for mercy so I can't load any other agents or image generators alongside it which sucks because I like to multitask my hardware.

My Dell T630 server is sitting there looking at me like it needs a meal so the plan is to hunt down another 3090 soon and slap it in there running dual cards is pretty much mandatory if you want to get serious about local LLMs and self hosting this kind of tech it is an expensive hobby but physical assets usually beat digital guesswork anyway I would rather have a stack of GPUs than a bag of useless tokens

Gonna have to grind a bit harder to pay for the upgrade but that is the game we play catch you guys later eh.

image.png
A screenshot of my latest dash update with Personaplex and some other stuff I never talked about.

2816696b41bf42f7acc3e9a8781460fd.gif
My inleo subs can have something like 1080 version with sounds included made! and much more for only 5 HBD!

I am a financial advisor ! If you can't take personal responsibility for you investing, I hate to brake it to ya, but you ain't nothing but a sucka, you supposed to lose your shit.

@bitcoinman's bits of wisdom

  • Invest only what you can afford to lose and be mindful of the potential risks.
  • Unless you can accept delivery stay away from futures and stick to physical.
  • Leverage is a great tool for losing money fast.
  • Numismatics for the lows stick to smart stacking baby.
  • Be cautious of new schemes in crypto, like ICOs, DeFi, and NFTs, do your research before investing.

hive bullion exhange.jpeg
BUY/SELL PRECIOUS METALS WITH HBD + PRECIOUS METALS TOOLS AND ACCESSORIES


You can find out more about the #silvergoldstackers community in this post here


Weekly Post Schedule

DayPost
MondayArt&3D
Tuesday
Wednesday
ThursdayLil Metal series
Friday
SaturdayLazy Saturday post
SundayTable silver series

That's it for today's post thanks for stopping by your support is truly appreciated.

Posted Using INLEO

Sort:  

Very expensive hobby, but a little hard work to pay it off will be worth it!
!PIMP
!BBH
!PIZZA

I do have fun with it but its more so like in the metals game how we encourage people to go physical, I pay a fair bit for cloud based AI, I am just budling up my local hardware and the open source AI models getting better so I can maybe look into saving money not paying for AI !PIMP !DOOK

 5 days ago Reveal Comment

You received an upvote of 100% from Precious the Silver Mermaid!

Please remember to contribute great content to the #SilverGoldStackers tag to create another Precious Gem.

PIZZA!

$PIZZA slices delivered:
@thebighigg(2/20) tipped @bitcoinman

Please vote for pizza.witness!