https://github.com/KerfuffleV2 — various random open source projects.

  • 3 Posts
  • 259 Comments
Joined 1 year ago
cake
Cake day: June 11th, 2023

help-circle














  • Smaller models (7B down to 350M) can handle long conversations better

    What are you basing that on? I mean, it is true there are more small models that support very long context lengths than big ones, but it’s not really because smaller models can handle them better, but because training big models takes a lot more resources. So people usually do that kind of fine-tuning on small models since training a 70B to 32K would take a crazy amount of compute and hardware.

    If you could afford fine tuning it though, I’m pretty sure the big model has at least the same inherent capabilities. Usually larger models deal with ambiguity and stuff better, so there’s a pretty good chance it would actually do better than the small model assuming everything else was equal.



  • Can you provide an example where science cannot explain a situation, because I can’t honestly think of any.

    Not OP, but there is some stuff. One big example is qualia. How does matter give rise to actual feelings, experiences of things? This isn’t something we can measure directly and it actually seems like it won’t be something we ever can measure. Might also be able to use something like “what was there before the big bang?” and that kind of thing.

    Of course, the fact that science can’t explain something doesn’t really justify falling back on magic as an explanation though. Some stuff just may not have an answer.



  • From dealing with their support in the past and stuff they’ve accommodated, I wouldn’t be surprised if you could just ask them to do it for a small amount like that. If you do a web search, you can also find a lot of information and people claiming it’s possible to do stuff like transfer it to a Paypal account, etc.

    I haven’t tried to do that personally, so maybe it really just isn’t possible. It’s still only something that will affect someone that’s never going to spend money at Amazon again, right? If I’m going to spend $5.99 at some point, it’s effectively the same as a cash refund for me. If I’m going to spend $10.99 at some point it’s almost the same as getting double the refund, since I would have spent cash instead in those cases.


  • Do we need to be more efficient?

    I mean, it’s usually a beneficial thing. Using less resources (including land) to produce the same amount of food is probably going to mean less environmental damage. In the case of switching to vat grown meat it also means not torturing billions of animals every year.

    We have the resources to feed everyone on Earth and have leftovers

    Sure. No one starves because the food just isn’t on this planet, they starve because the people who have it won’t give it to them. That said, we’re also not using resources very sustainably so saying we produce enough food currently isn’t the same as saying we can continue this way.

    We could also increase efficiency even further by reducing meat/dairy consumption.

    I don’t eat any animal products so you can probably guess this is something I’m strongly in favor of as well!

    Anyway, I was just responding to what I quoted not specifically arguing for 3d-printed foods. Depending on how it’s implemented, it may or may not be better environmentally than the status quo