I used to feel the same way until I found some very interesting performance results from 3B and 7B parameter models.

Granted, it wasn’t anything I’d deploy to production - but using the smaller models to prototype quick ideas is great before having to rent a gpu and spend time working with the bigger models.

Give a few models a try! You might be pleasantly surprised. There’s plenty to choose from too. You will get wildly different results depending on your use case and prompting approach.

Let us know if you end up finding one you like! I think it is only a matter of time before we’re running 40B+ parameters at home (casually).

Thanks for sharing this!

Good bot, I will do that next time.

Come hangout with us at [email protected]

I run this show solo at the moment, but do my best to keep everyone informed. I have much more content on the horizon. Would love to have you if we have what you’re looking for.

FOSAI Posts:

• Free Open-Source AI Nexus of Resources
• Lemmy Crash Course to Free Open-Source AI

I had an issue with a cross post like this with another post I made, but I didn’t know they defederated with us so maybe that’s why the bug is happening. I deleted the beehaw posts so hopefully that cleans up your feed? I’ll just avoid cross posting there in general.

For anyone unaware, this is probably one of the better short and sweet explanations in regards to what HuggingFace is.

It is a hub for many code repositories hosting AI specific files and configurations, which has become a core ecosystem of many artificial intelligence breakthroughs, platforms, and applications.

🤗

FWIW, it’s a new term I am trying to coin in FOSS communities (Free, Open-Source Software communities). It’s a spin off of ‘FOSS’, but for AI.

There’s literally nothing wrong with FOSS as an acronym, I just wanted to use one more focused in regards to AI tech to set the right expectations for everything shared in /c/FOSAI

I felt it was a term worth coining given the varied requirements and dependancies AI/LLMs tend to have compared to typical FOSS stacks. Making this differentiation is important in some of the semantics these conversations carry.

Big brain moment.

Ironically, I think using this technology to do exactly that is one of its greatest strengths…

GL, HF!

Great suggestions! I’ve actually never interfaced with that first channel (SECourses). Looks like some solid tutorials. Definitely going to check that out. Thanks for sharing!

Lol, you had me in the first half not gonna lie. Well done, you almost fooled me!

Glad you had some fun! gpt4all is by far the easiest to get going with imo.

I suggest trying any of the GGML models if you haven’t already! They outperform almost every other model format at the moment.

If you’re looking for more models, TheBloke and KoboldAI are doing a ton for the community in this regard. Eric Hartford, too. Although TheBloke is typically the one who converts these into more accessible formats for the masses.

Thank you! Consider subscribing to /c/FOSAI if you want to stay in the loop with the latest and greatest news for AI.

This stuff is developing at breakneck speeds. Very excited to see what the landscape will look like for AI by the end of this year.

Absolutely! I’m having a blast launching /c/FOSAI over at Lemmy.world. I’ll do my best to consistently cross-post for everyone over here too!

It’s been a short amount of time since the blackouts. I am optimistic we’ll continue to grow as people discover the value of the Fediverse and explore its many facets.

Right now, it feels like a weird snapshot of the internet before social media. A feeling I thought was gone with the times. Perhaps that will change, but it’s refreshing imho.

So far I am pleasantly surprised with Lemmy. Change can be good, I for one welcome this change!

F

I say let’s keep up this momentum and continue making this a space people want to be in and engage with.

We’re already off to a strong start, let’s commit and see what new corner of the internet we can define for ourselves.