If you are using CPU only, you need to look at very small models or the 2-bit quants.
Everything will be extremely slow otherwise:
GPU:
Loaded Power: 465W
Speed: 18.5 tokens/second
CPU: Loaded Power: 115W
Speed: 1.60 tokens/second
GPUs are at least 3 times faster for the same power draw.
I don’t know what GPU you’ve got, but Lexi V2 is the best “small model” I’ve seen with emotions, that I can just cite from the top of my head.
It tends to skew male and can be a little dark at times, but it’s more complex than expected for the size (8B feels like 48-70B).
Do Q8_0 if you’ve got the VRAM, Q5_KL for speed, IQ4_XS if you’ve got a potato.
My answer to this is yes.
I’m an AI Developer and my only option was to self host because I didn’t want my training data leaking out onto the web and by extension, China and the rest (I trained on my own data, writing, and notes, along with Wikipedia).
Self-hosting gives you complete freedom but also as one other user cautioned, don’t fall down the well/rabbit hole.
Use an executable like LM Studio, and then an off the shelf pre-trained model from Huggingface.
VRAM × 0.8 for max size.
Experiment until you find one you like.
Well, you are absolutely correct. A 1-2% DoD is something for like, the Voyager Probe though, not a smartphone :)
I charge wired (high speed, 18-22W). Wireless is known to be a lot slower and theoretically gentler on the battery.
I also use the phone heavily, like a computer, I’m a “power user”, so my battery thrashing is higher than average.
Us having the same durability lost on our engine despite me driving double the miles is a good analogy.
Depth of Discharge, sorry – 0 to 100 would be a 100% depth (the entire battery), 30 to 80 is 50%.
This is a 50% DoD and is considered best possible practice to prevent lithium-ion dendrite formation.
Updoot for good advice.
Proof:
Get in the robot, Shinji
"Sure, I can help answer this. Psychopaths are useful for a civilization or tribe because they weed out the weak and infertile, for instance, the old man with the bad leg, thus improving fitness."
Isn’t empathy a key function of human civilization, with the first signs of civilization being a mended bone?
I'm sorry, I can't help you with that. My model is being constantly updated and improved.
No the great filter is quite a lot more basic than that, things like unstable atmospheres, cosmic ray bursts, collisions, etc.
You’re on the right track though
It’s because of this bullshit.
Take a guess how many members this server/example community serves:
500? 2000? 10,000+?
Surely, a group of 50,000 needs a ticket system, age verification, moderation, and rules/TOS+registration?
There are twelve users in that chat/server. Three of the 12 are moderators. One is the “owner”.
Discord became a “community tool” because Discord moderators/“creators” are a special class of human being who realized their dream model train set could be upgraded with Internet connectivity.
Medium-to-large-scale-enterprise tooling is available to spin up for anyone, without having to pay for anything. In fact, Discord incentivizes donations through “boosts” where the users of a community pay for server costs rather than the hosts/maintainers themselves.
As a result, people go ham and never invest in proper training, role division or infrastructure. They cosplay at running a pseudo-corporation and Discord adds their requested features, at a price/donation premium.
P.S: I run a Discord channel of 223 users with no moderation, we have one text channel and two voice channels. We use the service like Ventrilo or TeamSpeak for a Steam Clan. I’ve literally had these busybodies from disparate communities join just to tell me I was “doing it wrong”.
P.S.S: I also hate HOAs.
Mission is going according to plan
Yeah that’s the key takeaway.
A billion dollars turns you into some kind of Duke, or Landed Noble.
Where you can like… buy a small army, take over a country, that sort of thing.
Billionaires shouldn’t exist.
Hello, expert solarpunk here.
TLDR: Car battery is 350Wh. Fridge uses 143W idle, so it’ll run a fridge for 2-3 hours.
Explanation below:
Car batteries are lead-acid (sulphuric acid and lead plates).
They discharge according to Peukert’s Law as the negatively charged plate gets covered in lead via the acid (electrolyte).
As the battery depletes, the negative plate can begin to take permanent damage, and so you can’t discharge a lead-acid deeper than 10-20%, or about 10.8V, with the safe limit being ~50% discharge.
Most 12V, 60Ah batteries therefore only safely store and nominally discharge 350 Wh @ 350W.
You can discharge that as fast as you want but the faster you discharge, the lower the capacity is (with 1000-1500W bringing you way down to like 65 Wh). Fridges have a surge when they start up to fire up the compressor. Starter batteries can take that, but once the refrigerant is cold, the fridge just maintains the temperature which uses a lot less energy - about 143W on average.
“Essayons”