Nuances

Jan. 11th, 2026 10:16 am
baroque_mongoose: A tabby cat with a very intelligent expression looking straight at the camera. (Default)
I'm feeling woozy again this morning, which is why I'm here posting rather than trundling off to church. It's annoying, but I'm sure the bright side will eventually show up.

Anyway, there's been a survey on Discord lately (which closed rather abruptly last night) to find out what people thought about adding AI features; I should think most people - certainly most people I know - responded much as I did or even more strongly, which was "no, thank you".

The thing is, I am not philosophically opposed to AI on principle, any more than I am to hand axes. You can certainly use a hand axe as a weapon, but ideally you use it to chop firewood and similar useful tasks. AI is, when you get right down to it, another hand axe; it's a tool, which can be - and has been - used for good purposes. AI excels at finding patterns, so it is particularly useful to help with questions like "are there any risk factors for disease X that we don't know about?". No; my problem with AI is not about its basic existence. It's about how it's being used.

I've actually programmed some AI, at a basic level. I think it would be a really good idea if everyone who can program at all did that, because it teaches you, in a way that nothing else can, exactly what AI is and isn't. In particular, it teaches you that it's not magic and that it's not 100% reliable, and that there are some things it is extremely bad at. To switch metaphors here, no matter how good your hammer is, not everything is a nail.

So that's my first issue with it: it's being used for things it isn't good at, and, not only that, but this is happening on such a scale that it's getting difficult to find decent stuff (if you doubt my word, go and look for sewing/knitting/crochet patterns on Etsy, but for goodness' sake don't buy them). Then there is, of course, the environmental issue. At the level I was programming it, AI is harmless in that respect, but massive AI models which use huge data centres use a lot of resources; that's not to say they should never be built, but it's very important that sustainability is taken into consideration. They should, at a bare minimum, use entirely renewable power sources and recycle the huge amounts of water they use.

And then there's the matter of exactly who's profiting from it. It is, perhaps, a little simplistic to say "if something is making Elon Musk even richer, it's a bad thing", but, more generally, AI should not be reinforcing inequality, and therefore there need to be good open-source alternatives available which are not compromised by the drive to funnel a lot of money into the hands of a few people. But then, having said that, there also need to be strong mental health safeguards in place; probably everyone by now has heard the tragic story of the teenager who was encouraged to kill himself by ChatGPT, but that is just the tip of a very worrying iceberg. AI psychosis is a real problem, and it's the main reason why I think as many people as possible should have some experience of programming it. It's a great deal harder to be thrown off your mental rails by something if you wrote the underlying code.

And, finally, there's the whole copyright issue. AI models need to be trained, and that's fair enough; but there is a great deal of stuff out there that's in the public domain, and if anything more specialised is needed it should be written in-house. I strongly believe that AI models should not be allowed to go scraping copyright works or people's private conversations to use them for training, and that goes double if the models are producing anything for them that is going to be sold for a profit.

So, as far as I'm concerned, yes, let's have AI, but let's have it in its place, with due concern for all the potential dangers; and that place, to my mind, really does not include Discord.
baroque_mongoose: A tabby cat with a very intelligent expression looking straight at the camera. (Default)
This morning I got an e-mail from a company asking me to review it on Trustpilot. I like this company a good deal, and I would be delighted to review it anywhere else. I am not, however, touching Trustpilot with the proverbial barge pole any more; and this is why.

One day last year I got an e-mail out of the blue from Trustpilot to say that they had taken down one of my reviews (which had been up there for several months) on the grounds that it might possibly be fraudulent. I didn't recall having reviewed that company, so initially I was just puzzled. I e-mailed them back asking for a copy of the text of the review so that I could confirm whether or not I had written it, and then we could take it from there. To this I got a canned response saying that they understood that I was disappointed but they couldn't change their decision.

Well, that was nothing at all to do with what I'd said; so I tried again, this time making what I was actually asking even clearer by putting it in bold type in a separate paragraph. My initial assumption was that my e-mail had been skim-read by some overworked grunt who was probably getting paid for answering e-mails as fast as possible. I got the identical canned response.

This is where I realised I was dealing with not so much AI as artificial stupidity. So I looked to see if there were other ways of contacting them that would necessarily involve a human in the loop; well, there was snail mail. I wrote them a letter explaining the situation, and requested them to reply by e-mail. Meanwhile, there was always a chance that if I kept the e-mail ticket open someone would eventually spot what was happening and respond, so I decided to keep replying to the canned response, and while I was waiting I might as well amuse myself by training their AI. In unexpected ways.

Trustpilot therefore got a whole string of e-mails from me; every time they sent me their identical canned response, I'd reply with an e-mail that started "this isn't relevant and I need to speak to a human" (or words to that effect), followed by something pretty much entirely random. I told their AI exactly how to fit a bra. I explained to it my philosophy of maths education. I gave it a lecture about arsenic poisoning during the Victorian period. Sometimes I just gave up and fed it a couple of paragraphs of lorem-ipsum. You get the idea.

I can't remember how I eventually got through to a human except that I do recall the letter didn't work; but in the end I did. It took more than two months. The human was actually very nice, and she did, at last, send me the text of the review, which enabled me to confirm that I had indeed written it. So I said, right, then, what exactly is the problem with it? I don't see how you can consider it in any way fraudulent. I've just told you I wrote it. What more do you need?

Ah. Well. Apparently the AI had picked up some kind of patterns in the text that were often associated with fraudulent reviews, and obviously they couldn't tell me what those were because they had to be secret so that fraudsters couldn't work round them, so for the protection of the general public they couldn't reinstate my review.

By this point I was really furious with them. I told them in no uncertain terms that they knew very well it wasn't fraudulent; I'd written it myself and I'd told them so. Being humans with brains, they could override the AI and it was their duty in this case to do so. But they were too scared to do that, so I said, right, in that case I am having no more to do with you, please tell me how to delete my account.

There was a pause for about a week, and then I did actually get an e-mail telling me how to delete my account.

It was in Italian.

No, really. The entire correspondence up to this point had been in English.

So I e-mailed them back in the same language asking them how on earth (come mai) they knew I spoke Italian, and thanking them for the information; I was quite seriously tempted to write "how the heck" (come cavolo), but decided that was perhaps a little lacking in dignity. Then I went and deleted my account, in English.

And they can all, as one says in Italian, go away and get themselves blessed.

Profile

baroque_mongoose: A tabby cat with a very intelligent expression looking straight at the camera. (Default)
baroque_mongoose

January 2026

S M T W T F S
     1 2 3
4 5 6 7 8 9 10
11 12 13 14 15 16 17
18 19 20 21 22 23 24
25262728293031

Syndicate

RSS Atom

Most Popular Tags

Style Credit

Expand Cut Tags

No cut tags
Page generated Jan. 25th, 2026 12:16 am
Powered by Dreamwidth Studios