• Korhaka@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    1
    ·
    edit-2
    4 days ago

    What are the “real costs” though? It’s free to run a half decent LLM locally on a mid tier gaming PC.

    Perhaps a bigger problem for the big AI companies rather then the open source approach.

    • conditional_soup@lemm.ee
      link
      fedilink
      arrow-up
      3
      ·
      4 days ago

      Sure, but ChatGPT costs MONEY. Money to run, and MONEY to train, and then they still have to make money back for their investors after everything’s said and done. More than likely, the final tally is going to look like whole cents per token once those investor subsidies run out, and a lot of businesses are going to be looking to hire humans back quick and in a hurry.