AI

Increased Traffic from Web-Scraping AI Bots is Hard to Monetize (yahoo.com) 57

"People are replacing Google search with artificial intelligence tools like ChatGPT," reports the Washington Post.

But that's just the first change, according to a New York-based start-up devoted to watching for content-scraping AI companies with a free analytics product and "ensuring that these intelligent agents pay for the content they consume." Their data from 266 web sites (half run by national or local news organizations) found that "traffic from retrieval bots grew 49% in the first quarter of 2025 from the fourth quarter of 2024," the Post reports. A spokesperson for OpenAI said that referral traffic to publishers from ChatGPT searches may be lower in quantity but that it reflects a stronger user intent compared with casual web browsing.

To capitalize on this shift, websites will need to reorient themselves to AI visitors rather than human ones [said TollBit CEO/co-founder Toshit Panigrahi]. But he also acknowledged that squeezing payment for content when AI companies argue that scraping online data is fair use will be an uphill climb, especially as leading players make their newest AI visitors even harder to identify....

In the past eight months, as chatbots have evolved to incorporate features like web search and "reasoning" to answer more complex queries, traffic for retrieval bots has skyrocketed. It grew 2.5 times as fast as traffic for bots that scrape data for training between the fourth quarter of 2024 and the first quarter of 2025, according to TollBit's report. Panigrahi said TollBit's data may underestimate the magnitude of this change because it doesn't reflect bots that AI companies send out on behalf of AI "agents" that can complete tasks on a user's behalf, like ordering takeout from DoorDash. The start-up's findings also add a dimension to mounting evidence that the modern internet — optimized for Google search results and social media algorithms — will have to be restructured as the popularity of AI answers grows. "To think of it as, 'Well, I'm optimizing my search for humans' is missing out on a big opportunity," he said.

Installing TollBit's analytics platform is free for news publishers, and the company has more than 2,000 clients, many of which are struggling with these seismic changes, according to data in the report. Although news publishers and other websites can implement blockers to prevent various AI bots from scraping their content, TollBit found that more than 26 million AI scrapes bypassed those blockers in March alone. Some AI companies claim bots for AI agents don't need to follow bot instructions because they are acting on behalf of a user.

The Post also got this comment from the chief operating officer for the media company Time, which successfully negotiated content licensing deals with OpenAI and Perplexity.

"The vast majority of the AI bots out there absolutely are not sourcing the content through any kind of paid mechanism... There is a very, very long way to go."
The Media

Linux Format Ceases Publication (mastodon.social) 28

New submitter salyavin writes: The final issue of Linux Format has been released. After 25 years the magazine is going out with a bang. Interviewing the old staff members, and looking back at old Linux distros [...] The last 10-15 years have been absolutely brutal to computer hobbyist magazines -- (or magazines and media at large, in general).
AI

OpenAI's Motion to Dismiss Copyright Claims Rejected by Judge (arstechnica.com) 102

Is OpenAI's ChatGPT violating copyrights? The New York Times sued OpenAI in December 2023. But Ars Technica summarizes OpenAI's response. The New York Times (or NYT) "should have known that ChatGPT was being trained on its articles... partly because of the newspaper's own reporting..."

OpenAI pointed to a single November 2020 article, where the NYT reported that OpenAI was analyzing a trillion words on the Internet.

But on Friday, U.S. district judge Sidney Stein disagreed, denying OpenAI's motion to dismiss the NYT's copyright claims partly based on one NYT journalist's reporting. In his opinion, Stein confirmed that it's OpenAI's burden to prove that the NYT knew that ChatGPT would potentially violate its copyrights two years prior to its release in November 2022... And OpenAI's other argument — that it was "common knowledge" that ChatGPT was trained on NYT articles in 2020 based on other reporting — also failed for similar reasons...

OpenAI may still be able to prove through discovery that the NYT knew that ChatGPT would have infringing outputs in 2020, Stein said. But at this early stage, dismissal is not appropriate, the judge concluded. The same logic follows in a related case from The Daily News, Stein ruled. Davida Brook, co-lead counsel for the NYT, suggested in a statement to Ars that the NYT counts Friday's ruling as a win. "We appreciate Judge Stein's careful consideration of these issues," Brook said. "As the opinion indicates, all of our copyright claims will continue against Microsoft and OpenAI for their widespread theft of millions of The Times's works, and we look forward to continuing to pursue them."

The New York Times is also arguing that OpenAI contributes to ChatGPT users' infringement of its articles, and OpenAI lost its bid to dismiss that claim, too. The NYT argued that by training AI models on NYT works and training ChatGPT to deliver certain outputs, without the NYT's consent, OpenAI should be liable for users who manipulate ChatGPT to regurgitate content in order to skirt the NYT's paywalls... At this stage, Stein said that the NYT has "plausibly" alleged contributory infringement, showing through more than 100 pages of examples of ChatGPT outputs and media reports showing that ChatGPT could regurgitate portions of paywalled news articles that OpenAI "possessed constructive, if not actual, knowledge of end-user infringement." Perhaps more troubling to OpenAI, the judge noted that "The Times even informed defendants 'that their tools infringed its copyrighted works,' supporting the inference that defendants possessed actual knowledge of infringement by end users."

AI

Bloomberg's AI-Generated News Summaries Had At Least 36 Errors Since January (nytimes.com) 25

The giant financial news site Bloomberg "has been experimenting with using AI to help produce its journalism," reports the New York Times. But "It hasn't always gone smoothly."

While Bloomberg announced on January 15 that it would add three AI-generated bullet points at the top of articles as a summary, "The news outlet has had to correct at least three dozen A.I.-generated summaries of articles published this year." (This Wednesday they published a "hallucinated" date for the start of U.S. auto tariffs, and earlier in March claimed president Trump had imposed tariffs on Canada in 2024, while other errors have included incorrect figures and incorrect attribution.) Bloomberg is not alone in trying A.I. — many news outlets are figuring out how best to embrace the new technology and use it in their reporting and editing. The newspaper chain Gannett uses similar A.I.-generated summaries on its articles, and The Washington Post has a tool called "Ask the Post" that generates answers to questions from published Post articles. And problems have popped up elsewhere. Earlier this month, The Los Angeles Times removed its A.I. tool from an opinion article after the technology described the Ku Klux Klan as something other than a racist organization.

Bloomberg News said in a statement that it publishes thousands of articles each day, and "currently 99 percent of A.I. summaries meet our editorial standards...." The A.I. summaries are "meant to complement our journalism, not replace it," the statement added....

John Micklethwait, Bloomberg's editor in chief, laid out the thinking about the A.I. summaries in a January 10 essay, which was an excerpt from a lecture he had given at City St. George's, University of London. "Customers like it — they can quickly see what any story is about. Journalists are more suspicious," he wrote. "Reporters worry that people will just read the summary rather than their story." But, he acknowledged, "an A.I. summary is only as good as the story it is based on. And getting the stories is where the humans still matter."

A Bloomberg spokeswoman told the Times that the feedback they'd received to the summaries had generally been positive — "and we continue to refine the experience."
The Media

'Wired' Drops Paywalls for Articles Based on Public Records Requests, Urges Other Sites to Follow (freedom.press) 26

Wired's web site "is going to stop paywalling articles that are primarily based on public records obtained through the Freedom of Information Act," their global editorial director announced this week: They're called public records for a reason, after all. And access to public documents is more important than ever at this moment, with government websites and records disappearing... [S]ome may argue that, from a business standpoint, not charging for stories primarily relying on public records automatically means fewer subscriptions and therefore less revenue. We disagree.

Sure, the FOIA process is time- and labor-intensive. Reporters face stonewalling, baseless denials, lengthy appeals processes, and countless other obstacles and delays. Investigative reports based on public records are among the most expensive stories to produce and share with the public... But while some readers might not subscribe to outlets that give away some of their best journalism for free, it's just as possible that readers will recognize this sacrifice and reward these outlets with more traffic and subscriptions in the long run...

We hope others will follow Wired's lead (and shoutout to outlets like 404 Media that also make their FOIA-based reporting available for free). We also hope those who stand to benefit from these outlets' leadership (that's you, reader) will do their part and subscribe if you can afford it. They're not asking for an arm and a leg... The Fourth Estate needs to step up and invest in serving the public during these unprecedented times. And the public needs to return the favor and support quality journalism, so that hopefully one day we can do away with those annoying paywalls altogether.

Crime

Sam Bankman-Fried Gives a Jailhouse Interview, Seeking a Pardon (msn.com) 67

Sam Bankman-Fried — one of the largest donors to the Democratic Party — "was convicted of fraud, sentenced to 25 years in prison and mostly went silent," reports the Wall Street Journal. "Until recently..." Now, from behind bars at the Metropolitan Detention Center in Brooklyn, Bankman-Fried is orchestrating an extraordinary public-relations blitz that looks very much like a campaign to make the most audacious trade of his career: support for President Trump's agenda in return for a presidential pardon...

There is little downside to Bankman-Fried's long-shot effort to secure a pardon. As the appeal that he filed last year works its way through the courts, Bankman-Fried, 33, is staring down a prison sentence that could extend until his 50s... The crowning touch of his campaign came on Thursday, when Bankman-Fried gave a jailhouse interview to "The Tucker Carlson Show," which was released on social-media channels including X and YouTube. Appearing on video in a brown jumpsuit, he criticized Washington bureaucrats and crypto regulators — and suggested that he went to prison out of political retribution... [Carlson's title for the interview? "Sam Bankman-Fried on Life in Prison With Diddy, and How Democrats Stole His Money and Betrayed Him."]

The interview hadn't been approved by the Federal Bureau of Prisons, according to a person familiar with the matter. Bankman-Fried spoke with Carlson through a link that is typically used by inmates to communicate with their lawyers, the person said. After the interview, Bankman-Fried was placed in solitary confinement, but he was out by Friday afternoon, according to a person familiar with the matter... Bankman-Fried is trying to highlight in media appearances and in any interaction with Trump's team that FTX customers are set to be made whole with interest through the bankruptcy proceedings — at least in dollar terms. Many of those creditors remain furious that they missed out on bitcoin's rally since November 2022.

Bankman-Fried "wants to set the record straight on his political beliefs, which he believes have been misconstrued," according to the article. "While he has given heavily to Democrats, he has also donated to Republican causes, including the contribution of millions to a group supporting Senator Mitch McConnell."

But the New York Times, citing "people with knowledge" of his pardon-seeking efforts, reported that "So far, the push does not appear to have gained traction."
The Media

Should Climate Change Be Acknowledged In Movies? (latimes.com) 229

The Los Angeles Times publishes a weekly "Boiling Point" newsletter about climate change and energy issues. And this week they examined whether the scientific fact of a change climate is reflected in the mass media: For the second year running, nonprofit consulting firm Good Energy applied its Climate Reality Check to the actual Oscar-nominated films [which] tests whether a movie and its characters acknowledge global warming... Of last year's 13 Oscar-nominated films that met Good Energy's criteria (feature-length movies set in present-day or near-future Earth) three passed the test. This year, there were 10 eligible films. Only "The Wild Robot" passed...

Maybe a few years from now, studios will release a torrent of movies and shows reflecting the realities of a scary-but-still-salvageable world, helmed by producers and writers jolted into renewed awareness by the infernos. But for now, the picture is bleak. A peer-reviewed study slated for publication this month, led by Rice University English and environmental studies professor Matthew Schneider-Mayerson, analyzes climate change mentions in 250 of the most popular movies of the last decade. The authors found that just 12.8% of the films allude to global warming. Just 3.6% depict or mention the climate crisis in two or more scenes. "A lot of times, it's really being mentioned in passing," Schneider-Mayerson said...

[Good Energy Chief Executive Anna Jane Joyner] pointed to another analysis led by Schneider-Mayerson, which found that movies passing the Climate Reality Check and released in theaters earned 10% more at the box office, on average, than films failing the test. Netflix, meanwhile, says on its website that 80% of its customers "choose to watch at least one story on Netflix that helps them better understand climate issues or highlight hopeful solutions around sustainability...." [Netflix's "Sustainability Stories" collection includes Dr. Seuss' The Lorax, Chicken Run: Dawn of the Nugget, and Waterworld]

Sponsors are interested in selling audiences on climate-friendly products, too. I was sitting in a movie theater last weekend enjoying "Captain America: Brave New World" — the latest entry in Disney's Marvel Cinematic Universe — when, to my surprise, Sam Wilson (Anthony Mackie) got out of his SUV and pulled his iconic red-white-and-blue shield out of the front trunk. Yes, a front trunk, where an internal combustion engine would normally be. That meant Captain America was driving an electric vehicle, right? Indeed, he was. I did some research after I got home and learned that Wilson was driving a GMC Hummer EV, the result of a paid partnership between Marvel Studios and GMC parent company General Motors.

Ironically, the movie does not at any point acknowledge global warming, the article points out (adding "Also, SUVs kill more pedestrians and cyclists than smaller cars.")

"But the more movies and TV shows spotlight climate solutions — electric vehicles, solar panels, induction stoves — the more likely people are to support those solutions. For Hollywood, that's a step in the right direction."
AI

Meet the Journalists Training AI Models for Meta and OpenAI (niemanlab.org) 18

After completing a journalism graduate degree, Carla McCanna took a job "training AI models to optimize accuracy and efficiency," according an article by Nieman Journalism Lab: Staff jobs are scarce... and the competition for them is daunting. (In 2024, the already beleaguered U.S. news industry cut nearly 5,000 jobs, up 59% from the previous year, according to an annual report from Challenger, Gray & Christmas....) For the past couple months, McCanna has been working close to full-time for [AI training data company] Outlier, picking up projects on its gig platform at about $35 per hour. Data work has quickly become her primary source of income and a hustle she's recommended [to her journalism program classmates]. "A lot of us are still looking for jobs. Three times I told someone what I do, and they're like, please send it to me," she said. "It's hard right now, and a lot of my colleagues are saying the same thing."

McCanna is just one of many journalists who has been courted by Outlier to take on part-time, remote data work over the past year... Several of them told me they have taken on Outlier projects to supplement their income or replace their work in journalism entirely, because of dwindling staff jobs or freelance assignments drying up. Some are early-career journalists like McCanna, but others are reporters with over a decade of experience. One thing they all had in common? Before last year they'd never heard of Outlier or even knew that this type of work existed.

Launched back in 2023, Outlier is a platform owned and managed by Scale AI, a San Francisco-based data annotation company valued at $13.8 billion. It counts among its customers the world's largest AI companies, including OpenAI, Meta, and Microsoft. Outlier, and similar platforms like CrowdGen and Remotasks, use networks of remote human workers to improve the AI models of their clients. Workers are paid by the hour for tasks like labeling training data, drafting test prompts, and grading the factual accuracy and grammar of outputs. Often their work is fed back into an AI model to improve its performance, through a process called reinforcement learning with human feedback (RLHF). This human feedback loop has been core to building models like OpenAI's GPT and Meta's Llama.

Aside from direct recruitment messages, I also found dozens of recent public job postings that underscore this growing trend of hiring journalists for data work... Rather than training a replacement, McCanna sees her data work as an asset, growing her knowledge of AI tools as they continue to embed in the workplace. "Actually doing this work you realize AI models still need us ... I think it's going to be a really, really long time until they can truly write like humans."

The Media

Server Attack Stops the Presses at US Newspaper Chain (augustafreepress.com) 25

They publish 77 newspapers in 26 U.S. states, according to Wikipedia. But this week a "cybersecurity event" at the newspapers' parent company "disrupted systems and networks," according to an article at one of their news sites which quotes an email sent to employees by the publishing company's CEO. "We have notified law enforcement of the situation."

And the company "has not released print or e-editions in most markets this week," according to the Augusta Free Press, "originally telling subscribers the outage was due to a server issue," The CEO said the company is also working to identify "additional steps we can take to help prevent something like this from happening again." The computer server appears to have compromised [last] Monday morning. No timeline has been announced for when news operations will return to normal publication schedules. According to a report in The News Virginian and published on the websites of the affected papers nationwide, the company is now producing, printing and delivering back issues, indicating at least some progress on printing and layout front...

Unfortunately, the cybersecurity attack on its server wasn't the only bad news for Lee Enterprises this week... In addition to the estimated $16.7 million the enterprise reported it lost in the last quarter, it has also gutted the staff of its newspapers as it appears to shift its focus toward more successful digital operations.

The Media

The Verge Explains Why, After 13 Years, It's Offering a 'Subscription' Option for Its Supporters (theverge.com) 27

"Okay, we're doing this," begins a new announcement at The Verge: Today we're launching a Verge subscription that lets you get rid of a bunch of ads, gets you unlimited access to our top-notch reporting and analysis across the site and our killer premium newsletters, and generally lets you support independent tech journalism in a world of sponsored influencer content. It'll cost $7 / month or $50 / year — and for a limited time, if you sign up for the annual plan, we'll send you an absolutely stunning print edition of our CONTENT GOBLINS series, with very fun new photography and design... A surprising number of you have asked us to launch something like this, and we're happy to deliver. If you don't want to pay, rest assured that big chunks of The Verge will remain free — we're thinking about subscriptions a lot differently than everyone else...

If you're a Verge reader, you know we've been covering massive, fundamental changes to how the internet works for years now. Most major social media platforms are openly hostile to links, huge changes to search have led to the death of small websites, and everything is covered in a layer of AI slop and weird scams. The algorithmic media ecosystem is now openly hostile to the kind of rigorous, independent journalism we want to do.

A few years ago, we decided the only real way to survive all this was to stand apart and bet on our own website so that we could remain independent of these platforms and their algorithms. We didn't want to write stories to chase Google Search trends or because we thought they'd do well on social media. And we definitely didn't want to compromise our famously strict ethics policy to accept brand endorsement deals from the companies we cover, which almost all of our competitors in the creator economy are forced to do in order to run sustainable businesses...

[W]e intend to keep making this thing together for a long, long time. So many of you like The Verge that we've actually gotten a shocking number of notes from people asking how they can pay to support our work. It's no secret that lots of great websites and publications have gone under over the past few years as the open web falls apart, and it's clear that directly supporting the creators you love is a big part of how everyone gets to stay working on the modern internet. At the same time, we didn't want to simply paywall the entire site — it's a tragedy that traditional journalism is retreating behind paywalls while nonsense spreads across platforms for free.

The print premium for subscribers is described as a "beautiful / deranged print product" that's drawn from a series of articles "about what Google had done to the web, capped off by a feature about search engine optimization titled 'The People Who Ruined the Internet.'" But it ships with a satirical cover that instead proclaims it as "The Verge Guide to Search Engine Optimization". A tongue-in-check announcement explains: [A] year has passed, and we've had a change of heart. Maybe search engine optimization is actually a good thing. Maybe appeasing the search algorithm is not only a sustainable strategy for building a loyal audience, but also a strategic way to plan and produce content. What are journalists, if not content creators? Anyway, SEO community, consider this our apology. And what better way to say "our bad, your industry is not a cesspool of AI slop but a brilliant vision of what a useful internet could look like" than collecting all the things we've learned in one handy print magazine? Which is why I'm proud to introduce The Verge Guide to Search Engine Optimization: All the Tips, Tricks, Hints, Schemes, and Techniques for Promoting High-Quality Content!
Whoops — slip off the cover and the real title appears: "CONTENT GOBLINS" (written in green slime). Again, it's "an anthology of stories about 'content' and the people who 'make' it." In very Verge fashion, we are meeting the moment where the internet has been overrun by AI garbage by publishing a beautifully designed, limited edition print product. (Also, the last time we printed a magazine, it won a very prestigious design award.) Content Goblins collects some of our best stories over the past couple years, capturing the cynical push for the world's great art and journalism to be reduced into units that can be packaged, distributed, and consumed on the internet. Consider Content Goblins as our resistance to that movement. With terrific new art and photography, we're making the case that great reporting is vital and enduring — and worth paying for.

This gorgeous, grotesque magazine can be yours if you commit to an annual subscription to The Verge — while supplies last.

The Media

Bezos: 'Presidential Endorsements Do Nothing' 388

theodp writes: "Presidential endorsements do nothing to tip the scales of an election," argues Jeff Bezos in The Hard Truth: Americans Don't Trust the News Media, a WaPo op-ed defense of his decision as owner of The Washington Post to end the newspaper's tradition of endorsing candidates for president.

"No undecided voters in Pennsylvania are going to say, 'I'm going with Newspaper A's endorsement.' None. What presidential endorsements actually do is create a perception of bias. A perception of non-independence. Ending them is a principled decision, and it's the right one. Eugene Meyer, publisher of The Washington Post from 1933 to 1946, thought the same, and he was right. By itself, declining to endorse presidential candidates is not enough to move us very far up the trust scale, but it's a meaningful step in the right direction. I wish we had made the change earlier than we did, in a moment further from the election and the emotions around it. That was inadequate planning, and not some intentional strategy."
The Media

Citing 'Crisis' in Local Reporting, Associated Press Creates Sister Organization to Seek Grants (apnews.com) 25

Founded in 1846, the not-for-profit Associated Press distributes its news stories to other news outlets. But are free online sites putting those outlets at risk?

This week the Associated Press wrote that a "crisis" in local and state news reporting "shows little signs of abating" — and that it's now setting up "a sister organization that will seek to raise money" for those outlets. The organization, which will have a board of directors independent of the AP, will solicit philanthropic spending to boost this news coverage, both within the AP and through outside organizations, the news outlet said Tuesday. "We feel we have to lean in at this point, not pull back," said Daisy Veerasingham, the AP's president and CEO. "But the supporting mechanism — the local newspaper market that used to support this — can't afford to do that anymore." Veerasingham said she's been encouraged by preliminary talks with some funders who have expressed concern about the state of local journalism...

The local news industry has collapsed over the past two decades, with the number of journalists working in newspapers dropping from 75,000 to 31,000 in 2022, according to Northwestern University. More than half of the nation's counties have no local news outlets or only one.

The AP's CEO offered this succinct summary of their goal. "We want to add new products and services to help the industry."
AI

OpenAI's 'Media Manager' Mocked, Amid Accusations of Robbing Creative Professionals (yahoo.com) 63

OpenAI's 'Media Manager' Mocked, Amid Accusations of Robbing Creative Professionals "Amid the hype surrounding Apple's new deal with OpenAI, one issue has been largely papered over," argues the Executive Director of America's writer's advocacy group, the Authors Guild.

OpenAI's foundational models "are, and have always been, built atop the theft of creative professionals' work." [L]ast month the company quietly announced Media Manager, scheduled for release in 2025. A tool purportedly designed to allow creators and content owners to control how their work is used, Media Manager is really a shameless attempt to evade responsibility for the theft of artists' intellectual property that OpenAI is already profiting from.

OpenAI says this tool would allow creators to identify their work and choose whether to exclude it from AI training processes. But this does nothing to address the fact that the company built its foundational models using authors' and other creators' works without consent, compensation or control over how OpenAI users will be able to imitate the artists' styles to create new works. As it's described, Media Manager puts the burden on creators to protect their work and fails to address the company's past legal and ethical transgressions. This overture is like having your valuables stolen from your home and then hearing the thief say, "Don't worry, I'll give you a chance to opt out of future burglaries ... next year...."

AI companies often argue that it would be impossible for them to license all the content that they need and that doing so would bring progress to a grinding halt. This is simply untrue. OpenAI has signed a succession of licensing agreements with publishers large and small. While the exact terms of these agreements are rarely released to the public, the compensation estimates pale in comparison with the vast outlays for computing power and energy that the company readily spends. Payments to authors would have minimal effects on AI companies' war chests, but receiving royalties for AI training use would be a meaningful new revenue stream for a profession that's already suffering...

We cannot trust tech companies that swear their innovations are so important that they do not need to pay for one of the main ingredients — other people's creative works. The "better future" we are being sold by OpenAI and others is, in fact, a dystopia. It's time for creative professionals to stand together, demand what we are owed and determine our own futures.

The Authors Guild (and 17 other plaintiffs) are now in an ongoing lawsuit against OpenAI and Microsoft. And the Guild's executive director also notes that there's also "a class action filed by visual artists against Stability AI, Runway AI, Midjourney and Deviant Art, a lawsuit by music publishers against Anthropic for infringement of song lyrics, and suits in the U.S. and U.K. brought by Getty Images against Stability AI for copyright infringement of photographs."

They conclude that "The best chance for the wider community of artists is to band together."
AI

Multiple AI Companies Ignore Robots.Txt Files, Scrape Web Content, Says Licensing Firm (yahoo.com) 108

Multiple AI companies are ignoring Robots.txt files meant to block the scraping of web content for generative AI systems, reports Reuters — citing a warning sent to publisher by content licensing startup TollBit. TollBit, an early-stage startup, is positioning itself as a matchmaker between content-hungry AI companies and publishers open to striking licensing deals with them. The company tracks AI traffic to the publishers' websites and uses analytics to help both sides settle on fees to be paid for the use of different types of content... It says it had 50 websites live as of May, though it has not named them. According to the TollBit letter, Perplexity is not the only offender that appears to be ignoring robots.txt. TollBit said its analytics indicate "numerous" AI agents are bypassing the protocol, a standard tool used by publishers to indicate which parts of its site can be crawled.

"What this means in practical terms is that AI agents from multiple sources (not just one company) are opting to bypass the robots.txt protocol to retrieve content from sites," TollBit wrote. "The more publisher logs we ingest, the more this pattern emerges."


The article includes this quote from the president of the News Media Alliance (a trade group representing over 2,200 U.S.-based publishers). "Without the ability to opt out of massive scraping, we cannot monetize our valuable content and pay journalists. This could seriously harm our industry."

Reuters also notes another threat facing news sites: Publishers have been raising the alarm about news summaries in particular since Google rolled out a product last year that uses AI to create summaries in response to some search queries. If publishers want to prevent their content from being used by Google's AI to help generate those summaries, they must use the same tool that would also prevent them from appearing in Google search results, rendering them virtually invisible on the web.
Google

How Google Will Distribute $100 Million to Canada's News Companies (www.cbc.ca) 36

In November Google agreed to pay Canadian news publishers $100 million annually "in order to be exempt from the Online News Act, which compels tech companies to enter into agreements with news publishers," writes the Canadian Press.

On Friday Google "named the organization it has selected to distribute the $100 million..." The Canadian Journalism Collective will be responsible for ensuring eligible news organizations get their share of the money. The collective is a federally incorporated non-profit organization that was created for this purpose. It was founded in May by a group of independent publishers and broadcasters... "We hope these next steps will be completed as quickly as possible, so Canadian publishers and journalists can soon begin to receive the proceeds of this new contribution model," Google said in a blog entry posted on their website Friday...

The money will be distributed proportionately based on how many full time-journalists the companies employ. Small print and digital outlets can expect to receive about $17,000 per journalist that they employ, an official with the Canadian Heritage Department has said.

Google's money will go to 1,520 news organizations, according to Google's blog post — which describes the arrangement as "addressing our concerns with the Online News Act" and "a viable path to an exemption at a clear and commercially acceptable commitment level..." As part of this transition, we have advised partners in our Google News Showcase program (our online news experience and licensing program for news organizations) will cease to operate in Canada later this year as we transition to this new contribution model. We will be maintaining some Google News Initiative programming in Canada. This includes a range of collaborative tools and resources that can support the advancement of quality journalism. However, with our monetary contribution in Canada now streamlined into the new single collective model, these investments will be non-monetary in nature.
Advertising

How Misinformation Spreads? It's Funded By 'The Hellhole of Programmatic Advertising' (wired.com) 66

Journalist Steven Brill has written a new book called The Death of Truth. Its subtitle? "How Social Media and the Internet Gave Snake Oil Salesmen and Demagogues the Weapons They Needed to Destroy Trust and Polarize the World-And What We Can Do."

An excerpt published by Wired points out that last year around the world, $300 billion was spent on "programmatic advertising", and $130 billion was spent in the United States alone in 2022. The problem? For over a decade there's been "brand safety" technology, the article points out — but "what artificial intelligence could not do was spot most forms of disinformation and misinformation..."

The end result... In 2019, other than the government of Vladimir Putin, Warren Buffett was the biggest funder of Sputnik News, the Russian disinformation website controlled by the Kremlin... Geico, the giant American insurance company and subsidiary of Buffett's Berkshire Hathaway, was the leading advertiser on the American version of Sputnik News' global website network... No one at Geico or its advertising agency had any idea its ads would appear on Sputnik, let alone what anti-American content would be displayed alongside the ads. How could they? Which person or army of people at Geico or its agency could have read 44,000 websites?

Geico's ads had been placed through a programmatic advertising system that was invented in the late 1990s as the internet developed. It exploded beginning in the mid 2000s and is now the overwhelmingly dominant advertising medium. Programmatic algorithms, not people, decide where to place most of the ads we now see on websites, social media platforms, mobile devices, streaming television, and increasingly hear on podcasts... If Geico's advertising campaign were typical of programmatic campaigns for broad-based consumer products and services, each of its ads would have been placed on an average of 44,000 websites, according to a study done for the leading trade association of big-brand advertisers.

Geico is hardly the only rock-solid American brand to be funding the Russians. During the same period that the insurance company's ads appeared on Sputnik News, 196 other programmatic advertisers bought ads on the website, including Best Buy, E-Trade, and Progressive insurance. Sputnik News' sister propaganda outlet, RT.com (it was once called Russia Today until someone in Moscow decided to camouflage its parentage), raked in ad revenue from Walmart, Amazon, PayPal, and Kroger, among others... Almost all advertising online — and even much of it on television (through streaming TV), or on podcasts, radio, mobile devices, and electronic billboards — is now done programmatically, which means the machine, not a planner, makes those placement decisions. Unless the advertiser uses special tools, such as what are called exclusion or inclusion lists, the publishers and content around which the ad appears, and which the ad is financing, are no longer part of the decision.

"What I kept hearing as the professionals explained it to me was that the process is like a stock exchange, except that the buyer doesn't know what stock he is buying... the advertiser and its ad agency have no idea where among thousands of websites its ad will appear."
The Media

Axios CEO Believes AI Will 'Eviscerate the Unprepared' Among Media Companies (seattletimes.com) 50

In the view of Jim VandeHei, CEO of Axios, artificial intelligence will eviscerate the weak, the ordinary, the unprepared in media," reports the New York Times: VandeHei says the only way for media companies to survive is to focus on delivering journalistic expertise, trusted content and in-person human connection. For Axios, that translates into more live events, a membership program centered on its star journalists and an expansion of its high-end subscription newsletters. "We're in the middle of a very fundamental shift in how people relate to news and information," he said, "as profound, if not more profound, than moving from print to digital." "Fast forward five to 10 years from now and we're living in this AI-dominated virtual world — who are the couple of players in the media space offering smart, sane content who are thriving?" he added. "It damn well better be us."

Axios is pouring investment into holding more events, both around the world and in the United States. VandeHei said the events portion of his business grew 60% year over year in 2023. The company has also introduced a $1,000-a-year membership program around some of its journalists that will offer exclusive reporting, events and networking. The first one, announced last month, is focused on Eleanor Hawkins, who writes a weekly newsletter for communications professionals. Her newsletter will remain free, but paying subscribers will have access to additional news and data, as well as quarterly calls with Hawkins... Axios will expand Axios Pro, its collection of eight high-end subscription newsletters focused on specific niches in the deals and policy world. The subscriptions start at $599 a year each, and Axios is looking to add one on defense policy...

"The premium for people who can tell you things you do not know will only grow in importance, and no machine will do that," VandeHei said....VandeHei said that although he thought publications should be compensated for original intellectual property, "that's not a make-or-break topic." He said Axios had talked to several AI companies about potential deals, but "nothing that's imminent.... One of the big mistakes a lot of media companies made over the last 15 years was worrying too much about how do we get paid by other platforms that are eating our lunch as opposed to figuring out how do we eat people's lunch by having a superior product," he said.

"VandeHei said Axios was not currently profitable because of the investment in the new businesses," according to the article.

But "The company has continued to hire journalists even as many other news organizations have cut back."
The Media

Mock 'News' Sites With Russian Ties Pop Up in U.S. (rawstory.com) 199

An anonymous reader shared this story from the New York Times: Into the depleted field of journalism in America, a handful of websites have appeared in recent weeks with names suggesting a focus on news close to home: D.C. Weekly, the New York News Daily, the Chicago Chronicle and a newer sister publication, the Miami Chronicle. In fact, they are not local news organizations at all. They are Russian creations, researchers and government officials say, meant to mimic actual news organizations to push Kremlin propaganda by interspersing it among an at-times odd mix of stories about crime, politics and culture.

While Russia has long sought ways to influence public discourse in the United States, the fake news organizations — at least five, so far — represent a technological leap in its efforts to find new platforms to dupe unsuspecting American readers. The sites, the researchers and officials said, could well be the foundations of an online network primed to surface disinformation ahead of the American presidential election in November...

The Miami Chronicle's website first appeared on Feb. 26. Its tagline falsely claims to have delivered "the Florida News since 1937."

Amid some true reports, the site published a story last week about a "leaked audio recording" of Victoria Nuland, the U.S. under secretary of state for political affairs, discussing a shift in American support for Russia's beleaguered opposition after the death of the Russian dissident Aleksei A. Navalny. The recording is a crude fake, according to administration officials who would speak only anonymously to discuss intelligence matters.

From the Raw Story: The network was discovered by Clemson University's Media Forensics Hub by researchers Patrick Warren and Darren Linvill, who tell the Times that its websites are designed to lend journalistic credibility to slickly produced propaganda. "The page is just there to look realistic enough to fool a casual reader into thinking they're reading a genuine, U.S.-branded article," Linvill told the Times.
Programming

'Communications of the ACM' Is Now Open Access (acm.org) 25

Long-time Slashdot reader theodp writes: CACM [Communications of the ACM] Is Now Open Access," proclaims the Association for Computing Machinery (ACM) in its tear-down-this-CACM-paywall announcement. "More than six decades of CACM's renowned research articles, seminal papers, technical reports, commentaries, real-world practice, and news articles are now open to everyone, regardless of whether they are members of ACM or subscribe to the ACM Digital Library."

Ironically, clicking on Google search results for older CACM articles on Aaron Swartz currently returns page-not-found error messages and the CACM's own search can't find Aaron Swarz either, so perhaps there's some work that remains to be done with the transition to CACM's new website. ACM plans to open its entire archive of over 600,000 articles when its five-year transition to full Open Access is complete (January 2026 target date).

"They are right..." the site's editor-in-chief told Slashdot. "We need to get Google to reindex the new site ASAP."
Electronic Frontier Foundation

EFF Challenges 'Legal Bullying' of Sites Reporting on Alleged Appin 'Hacking-for-Hire' (eff.org) 16

Long-time Slashdot reader v3rgEz shared this report from MuckRock: Founded in 2003, Appin has been described as a cybersecurity company and an educational consulting firm. Appin was also, according to Reuters reporting and extensive marketing materials, a prolific "hacking for hire" service, stealing information from politicians and militaries as well as businesses and even unfaithful spouses.

Legal letters, being sent to newsrooms and organizations around the world, are trying to remove that story from the internet — and are often succeeding.

Reuters investigation, published in November, was based in part on corroborated marketing materials, detailing a range of "hacking for hire" services Appin provided. After publication, Reuters was targeted by a legal campaign to shut down critical reporting, an effort which expanded to target news organizations around the world, including MuckRock. With the help of the Electronic Frontier Foundation, MuckRock is now sharing more details on this effort while continuing to host materials the Association of Appin Training Centers has gone to great lengths to remove from the web.

The original story, by Reuters' staff writers Raphael Satter, Zeba Siddiqui and Chris Bing, is no longer available on the Reuters website. Following a preliminary court ruling issued in New Delhi, the story has been replaced with an editor's note, stating that Reuters "stands by its reporting and plans to appeal the decision." The story has since been reposted on Distributed Denial of Secrets, while the primary source materials that Reuters reporters and editors used in their reporting are available on MuckRock's DocumentCloud service.

Representatives of the company's founders denied the assertions in the Reuters story, insisting instead that rogue actors "were misusing the Appin name."

TechDirt titled their article "Sorry Appin, We're Not Taking Down Our Article About Your Attempts To Silence Reporters."

And Thursday the EFF wrote its own take on "a campaign of bullying and censorship seeking to wipe out stories about the mercenary hacking campaigns of a less well-known company, Appin Technology, in general, and the company's cofounder, Rajat Khare, in particular." These efforts follow a familiar pattern: obtain a court order in a friendly international jurisdiction and then misrepresent the force and substance of that order to bully publishers around the world to remove their stories. We are helping to push back on that effort, which seeks to transform a very limited and preliminary Indian court ruling into a global takedown order. We are representing Techdirt and MuckRock Foundation, two of the news entities asked to remove Appin-related content from their sites... On their behalf, we challenged the assertions that the Indian court either found the Reuters reporting to be inaccurate or that the order requires any entities other than Reuters and Google to do anything. We requested a response — so far, we have received nothing...

At the time of this writing, more than 20 of those stories have been taken down by their respective publications, many at the request of an entity called "Association of Appin Training Centers (AOATC)...." It is not clear who is behind The Association of Appin Training Centers, but according to documents surfaced by Reuters, the organization didn't exist until after the lawsuit was filed against Reuters in Indian court....

If a relatively obscure company like AOATC or an oligarch like Rajat Khare can succeed in keeping their name out of the public discourse with strategic lawsuits, it sets a dangerous precedent for other larger, better-resourced, and more well-known companies such as Dark Matter or NSO Group to do the same. This would be a disaster for civil society, a disaster for security research, and a disaster for freedom of expression.

Slashdot Top Deals