• ItJustDonn@slrpnk.net
    link
    fedilink
    English
    arrow-up
    6
    ·
    2 days ago

    Open source means it can be publicly audited to help soothe suspicion, right? I imagine that would take time, though, if it’s incredibly complex

    • Alex@lemmy.ml
      link
      fedilink
      English
      arrow-up
      15
      arrow-down
      1
      ·
      2 days ago

      Open source is a very loose term when it comes to GenAI. Like Llama the weights are available with few restrictions but importantly how it was trained is still secret. Not being reproducible doesn’t seem very open to me.

        • Alex@lemmy.ml
          link
          fedilink
          English
          arrow-up
          5
          ·
          2 days ago

          Their paper outlines the training process but doesn’t supply the actual data or training code. There is a project on huggingface: https://huggingface.co/blog/open-r1 that is attempting a fully open recreation based on what is public.