At Microsoft, we’re expanding AI capabilities by training small language models to achieve the kind of enhanced reasoning and comprehension typically found only in much larger models.
  • Pennomi@lemmy.worldEnglish
    3·
    1 year ago

    How does it compare to Mistral? That’s the best performing 7b model and it’s suspiciously missing from this report.

    • noneabove1182@sh.itjust.worksOPMEnglish
      2·
      1 year ago

      I’m looking forward to trying it today, I think this might make a good RAG model based on the orca 2 paper, but testing will be needed