• 0 Posts
  • 54 Comments
Joined 3 years ago
cake
Cake day: September 13th, 2023

help-circle
  • I’d really like to see a source for the first guy’s numbers, especially how he accounts for things like training and water usage at the power plant, and as for the second guy, Anthropic is not preserving shit. The Internet Archive preserves books. Anthropic scans them and doesn’t publish the scans so that they can train an LLM that might or might not be able to regurgitate some fragments of that text, and publish that. That’s preservation in the same way that painting a picture of you is keeping you alive forever.

    Also, neither of those address the effects on creatives’ livelihoods or the mental health of LLM users. Chatbot psychosis is real. People who routinely use LLMs to do things provably become worse at doing them without them. Students use LLMs to make an end run around having to learn everything they need to know to be effective members of a society, like how to articulate their points, how not to fall for rhetorical traps, what history was really like, and between that and the disastrous effects of No Child Left Behind, teachers are quitting in droves and there’s a literacy crisis.


  • The author of that article admits that the sample size is not large enough to draw meaningful conclusions.

    But besides that, I believe LLM code generators can be a useful tool, provided you are willing to go over their output with a fine-tooth comb and assume it is broken until you have proven otherwise, because the hallucination problem is inherent to the technology and they’re never going to completely solve it, and are willing to overlook the myriad ethical issues with all major LLMs in existence today.





  • I’ve been a programmer for two thirds of my life up to this point. I don’t see how the machine that generates code that must be assumed to be broken, and statements about said code that must be assumed to be wrong, until both have been manually verified, because the “hallucination” issue is inherent to the design of LLMs and cannot be solved, is supposed to make my life easier. Especially since a well known problem in computer science is that writing code is more fun than reading it.

    If you’re using AI for code generation, I hope you like reading code.

    If you’re using AI to learn your way around an existing codebase, I hope you’re prepared to fact check everything it tells you.

    If you’re using AI for code review before merging a PR, fucking yikes. What made you think the sycophant machine that once told users a soggy cereal bar was a great business opportunity and cannot even transcribe McDonald’s orders correctly was suitable for that purpose?

    If you’re telling yourself it’s okay because there’s a human in the loop, please read some studies about decision fatigue and consider that increasing the number of critical decisions a person must make per day, while giving them a suggested answer that’s right 90% of the time and catastrophically wrong the remaining 10%, and the only way to tell the difference is to read in depth, might not have the desired effect. Especially if the human in question is then put under time pressure.

    And all that is before I go on a five paragraph rant about the ethical transgressions of every major AI company.

    It’s pretty black and white for me.


  • …So you insist that AI power use isn’t a big problem right now, but your best case scenario for the future is that humanity gets nuked out of existence. By nukes that were designed using help from LLMs, which they haven’t been shown to be able to help with.

    You seem like a very serious person who is worth debating.

    As for the data use thing, firstly, I don’t know why the choices are between the actual work and hearsay. I don’t know where you got those two options from. I also don’t know what would be producing the hearsay (human? LLM? If the latter, are we straight up admitting to copyright laundering? Also, I thought training LLMs on output of previous LLMs caused model collapse). I especially don’t know why you’re asking me to speculate on what creatives want immediately after attacking my ability to speak on behalf of creatives. But since you are apparently asking me to do that, I think they’d prefer the hearsay, since the point is that they don’t want the model to be able to imitate their work for anyone who asks for cheap, and in so doing, put them out of a job. Or worse, have the model agree to a job they would have said no to, and damage their credibility and brand.








  • Pro tip: when copying a link to a Lemmy/Piefed/Kbin/etc post, please make sure you use your instance’s option to copy the link to the post on its original instance (the instance the post was made on), rather than simply copying the link to the post on your instance out of your URL bar. On your instance’s web interface, that option is in the More drop down next to the Boost button, just below the post title. (On a Lemmy instance, the link to the original post is the Fediverse icon right next to the upvote and downvote buttons, and you can right click and Copy Link from there).

    Obviously, when you open a post in the browser on an instance that isn’t yours by clicking a link (for example, this link to this same post on my instance, which is a vanilla Lemmy instance), you can’t interact with it, because you aren’t logged in, because you don’t have an account on that instance. To interact with it, you need to open the same post through your own instance.

    If you have a link to a post on the instance it was created on, you can simply paste that URL (the whole thing) into your instance’s search bar to open it on there, so you can vote/comment/etc. Some mobile apps can even do this automatically. However, this doesn’t work if you paste a link to a post through an instance other than the instance it was created on. In order to interact with the post you just linked to, people have to click the link to open the post on your instance, then click the button on there to copy the original link, before pasting it into their own instance. It’s polite not to make them go through that extra work.

    Judging by your account age, it seems you’re new to Lemmy, so you probably didn’t know that. Just something to keep in mind for future. :)