Cult I Mean Group
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
🇦🇺𝕄𝕦𝕟𝕥𝕖𝕕𝕔𝕣𝕠𝕔𝕠𝕕𝕚𝕝𝕖@lemm.ee to Free Open-Source Artificial Intelligence@lemmy.worldEnglish · 1 year ago

What service should i use for AI backend that isn't openai - lemm.ee

lemm.ee

external-link
message-square
3
fedilink
7
external-link

What service should i use for AI backend that isn't openai - lemm.ee

lemm.ee

🇦🇺𝕄𝕦𝕟𝕥𝕖𝕕𝕔𝕣𝕠𝕔𝕠𝕕𝕚𝕝𝕖@lemm.ee to Free Open-Source Artificial Intelligence@lemmy.worldEnglish · 1 year ago
message-square
3
fedilink
I have written myself a web fronetend using langchain that uses a json based agent to do advanced tool use (websearch, calculations, document summarisation/information extraction, etc) and chain of thought reasoning. At the moment im using openai gpt-4-turbo for the main agent and gpt-3.5-turbo for some of the summation tools but openai models are limited in capabilities (wont talk about certain topic to the point of disregarding required output json formatting). What service can use that will run a preferably foss model as powerfull as gpt-4 that is pay per use with a langchain integration? here’s the project https://github.com/muntedcrocodile/Sydney [https://github.com/muntedcrocodile/Sydney] EDIT: Added link to project
alert-triangle
You must log in or register to comment.
  • MrPoopyButthole@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    The only really capable models are from OpenAI, Anthropic, and Meta. They all have guard rails of some kind and you need to use a supervisor agent to decide if the output is as you wanted if you can’t use something more basic like a JSON parser. Google Bard/Gemini output is not that high quality IMO.

    • 🇦🇺𝕄𝕦𝕟𝕥𝕖𝕕𝕔𝕣𝕠𝕔𝕠𝕕𝕚𝕝𝕖@lemm.eeOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      I have a guardrails ensuring proper json output that works 99% of the time except chatgpt has been so lobotomised that it ignores that for the I can’t answer that default responces. What about mistral models I’ve played with then but haven’t found any services that let me just point at an api and fire.

  • PeepinGoodArgs@reddthat.com
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    7 months ago

    deleted by creator

    • johntash@eviltoast.org
      link
      fedilink
      English
      arrow-up
      3
      ·
      1 year ago

      Not sure if that’s a typo or not, but gpt4 is definitely not open source

      • PeepinGoodArgs@reddthat.com
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        7 months ago

        deleted by creator

Free Open-Source Artificial Intelligence@lemmy.world

fosai@lemmy.world

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !fosai@lemmy.world

Welcome to Free Open-Source Artificial Intelligence!

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

More AI Communities

  • !localllama@sh.itjust.works
  • !models@lemmy.intai.tech
  • !artificial_intel@lemmy.ml
  • LocalLLaMA (Reddit)

LLM Leaderboards

  • HuggingFace Open LLM Leaderboard
  • LMSYS Chatbot Arena

Developer Resources

  • Replicate
  • vLLM
  • RunPod
  • Vast AI
  • Together AI
  • AI Horde

GitHub Projects

  • GitHub Stars

FOSAI Time Capsule

  • The Internet is Healing
  • General Resources
  • FOSAI Welcome Message
  • FOSAI Crash Course
  • FOSAI Nexus Resource Hub
  • FOSAI LLM Guide
Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 1 user / day
  • 1 user / week
  • 30 users / month
  • 437 users / 6 months
  • 1 local subscriber
  • 3.63K subscribers
  • 247 Posts
  • 600 Comments
  • Modlog
  • mods:
  • Blaed@lemmy.world
  • fosai@lemmy.world
  • BE: 0.19.8
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org