Skip to main content

Endless Buffet

 The days of all you can eat days of trawling data to train AI are winding down. As always, the companies that precipitated the problem of content creators shutting down access are the ones that will be the least impacted by it. They will just pay their way out and also control what the AI does so users will see a filtered and distorted responses that are aligned with the company's interests. The up and commers will have to choose between dying out from lack of data or working around the barriers somehow:

Another challenge is that while publishers can try to stop A.I. companies from scraping their data by placing restrictions in their robots.txt files, those requests aren’t legally binding, and compliance is voluntary. (Think of it like a “no trespassing” sign for data, but one without the force of law.)

Major search engines honor these opt-out requests, and several leading A.I. companies, including OpenAI and Anthropic, have said publicly that they do, too. But other companies, including the A.I.-powered search engine Perplexity, have been accused of ignoring them.

The likes of Perplexity might have to throw in the towel eventually. Turn to some horrible ad-supported model where the AI responds in a way that is most advantageous to advertisers or they just get acquired by one of the big companies who don't want the annoyance of a pesky little newcomer trying to upstage them. Either way, we the users of search end up holding the bag.

Comments

Popular posts from this blog

Cheese Making

I never fail to remind J that there is a time and place for everything. It is possibly the line she will remember me by when I am dead and gone given how frequently she hears it. Instead of having her breakfast she will break into a song and dance number from High School Musical well past eight on Monday morning. She will insist that I watch and applaud the performance instead of screaming at her to finish her milk and cereal. Her sense of occasion is seriously lacking but then so is mine. Consider for example, a person walks into the grocery store with the express purpose of buying detergent because they are fresh out of it and laundry is only half way done. However instead of heading straight for detergent, they wander over to the natural foods aisle and go berserk upon finding goat milk on sale for a dollar a gallon. They at once proceed to stock pile so they can turn it to huge quantities home-made feta cheese. That person would be me. It would not concern me in the least that I ha...

Part Liberated Woman

An expat desi friend and I were discussing what it means to return to India when you have cobbled together a life in a foreign country no matter how flawed and imperfect. We have both spent over a decade outside India and have kids who were born abroad and have spent very little time back home. Returning "home" is something a lot of new immigrants like L and myself think about. We want very much for that to be an option because a full assimilation into our country of domicile is likely never going to happen. L has visited India more often than I have and has a much better pulse on what's going on there. For me the strongest drag force working against my desire to return home is my experience of life as a woman in India. I neither want to live that suffocatingly sheltered existence myself nor subject J to it. The freedom, independence and safety I have had in here in suburban America was not even something I knew I could expect to have in India. I never knew what it felt t...

Under Advisement

Recently a desi dude who is more acquaintance less friend called to check in on me. Those who have read this blog before might know that such calls tend to make me anxious. Depending on how far back we go, there are sets of FAQs that I brace myself to answer. The trick is to be sufficiently evasive without being downright offensive - a fine balancing act given the provocative nature of questions involved. I look at these calls as opportunities for building patience and tolerance both of which I seriously lack. Basically, they are very desirous of finding out how I am doing in my personal and professional life to be sure that they have me correctly categorized and filed for future reference. The major buckets appear to be loser, struggling, average, arrived, superstar and uncategorizable. My goal needless to say, is to be in the last bucket - the unknown, unquantifiable and therefore uninteresting entity. Their aim is to pull me into something more tangible. So anyways, the dude in ques...