• mountainriver@awful.systems
    link
    fedilink
    English
    arrow-up
    3
    ·
    7 hours ago

    “This is the perfect opportunity to describe retrieval-augmented generation (RAG).” We assume the family had already threatened violence if he mentioned bitcoin.

    It is also lovely that the quote follows directly after Google’s glue in pizza. Just pivot to something else.

    But since I don’t trust the linked AI fondler’s description, what is RAG? Sounds like an LLM stapled to a search engine.

    • rook@awful.systems
      link
      fedilink
      English
      arrow-up
      4
      ·
      4 hours ago

      If it were merely a search engine, it risks not being ai enough. We already have search engines, and no one is gonna invest in that old garbage. So instead, it finds something that you might want that’s been predigested for ease of ai consumption (Retrieval), dumps it into the context window alongside your original question (Augmentation) and then bullshits about it (Generation).

      Think of it as exactly the same stuff that the LLM folk have already tried to sell you, trying to work around limitations of training and data availability by providing “cut and paste as a service” to generate ever more complex prompts for you, in the hopes that this time you’ll pay more for it than it costs to run.