Tag: United Kingdom

  • Platforms under pressure in UK over intimate images

    Platforms under pressure in UK over intimate images

    Online platforms operating in Britain have until the end of this month to put automated detection technology in place to stop the spread of non-consensual intimate images, including AI-generated deepfakes, or to demonstrate that what they do instead works as well.

    The communications regulator Ofcom opened an enforcement programme on 9 September to monitor how technology firms are meeting that duty. Companies that fail to comply face fines of up to 10 per cent of their global annual revenue.

    The technology at issue is hash matching, which converts an image into a digital fingerprint that can be checked against later attempts to upload the same picture, without the image itself having to be compared by hand or leave the victim’s possession.

    “Non-consensual intimate image abuse can have a devastating impact on victims, causing lasting distress and harm,” said Almudena Lara, Ofcom’s online safety policy development director.

    “Technology companies now have a legal responsibility to put the right tools in place to stop this kind of deeply harmful content spreading on their services. The deadline is fast approaching and firms that ultimately fail to comply with their duties can expect us to take robust action under our enforcement programme.”

    The helpline behind the database

    Ofcom said it had partnered with SWGfL, the organisation that runs the StopNCII.org hash database and the Revenge Porn Helpline, to share information and evidence on what works. It continues to recommend that platforms use StopNCII’s tool.

    David Wright, SWGfL’s chief executive, said demand on the helpline was growing sharply, and that the organisation’s research suggested more than 369,000 women in the United Kingdom experience this abuse each year.

    “Requiring platforms to adopt hash matching is a vital shift toward stopping this abuse before it spreads, rather than only responding once the damage is already done,” he said. “The infrastructure is already in place and ready for platforms to use.”

    Forty-eight hours

    Ofcom said it would consult by the end of this year on strengthening its Illegal Harms Codes of Practice to reflect a change in the law that will require platforms to take down reported non-consensual intimate images within 48 hours.

    That is the same deadline set by the Take It Down Act in the United States, under which a man in Ohio was sentenced to 15 years last week in the first prosecution brought since the law was enacted.

    A wider call for evidence

    Separately, Ofcom has asked academics, survivor and victim support groups and others for evidence on how women’s and girls’ experiences online have changed since it published guidance for a safer life online for women and girls last year. Responses are due by 6 November.

    Alongside intimate image abuse, that guidance asked services to reduce the reach and spread of misogynistic abuse and sexual violence, prevent coordinated pile-ons and harassment, strengthen privacy protections including limits on location-sharing features, and improve reporting and support tools for victims.

    Ofcom said it would publish a report next summer on how far the industry had got. If the industry falls short, it said, it will consider making formal recommendations to government on where the Online Safety Act may need to be strengthened.

  • Tech abuse linked to partner killings: The UK evidence

    Tech abuse linked to partner killings: The UK evidence

    Technology-facilitated abuse featured in two in five intimate partner homicides in the United Kingdom, according to an analysis of statutory death reviews published by The Observer on Tuesday.

    The newspaper examined every report on an intimate partner killing in the government’s Domestic Homicide Review Library up to April. The library records 647 deaths between 2004 and 2022, of which intimate partner cases account for 75 per cent, or 487 reports. In 85 per cent of those the victim was a woman and the perpetrator a man.

    Domestic Homicide Reviews are statutory multi-agency reviews, carried out when the death of a person over 16 is thought to have resulted from domestic abuse. They are conducted with the participation of the agencies involved, which makes them a different kind of record from survey data or press reports.

    Nicole Jacobs, the domestic abuse commissioner, was quoted as saying the analysis showed the “devastating consequences” of technology abuse and called for stronger responses from police and public services. She said she hears “daily” from survivors who report it and are told by police to “simply stop using it, change the password, or block their perpetrator”.

    “As technology evolves, so do abusers’ tactics. Right now our current risk indicator tools, used by the police and other public services to safeguard victims, are not keeping up with the danger of this abuse.”

    What was found

    The Observer identified four methods of technology-facilitated abuse, and a fifth category in which perpetrators restricted a victim’s access to technology. It reports that many cases featured more than one form. Its findings, in its own terms:

    • Harassment — using technology to bombard victims with communication, send threatening messages, and distribute intimate images without consent — was “the most common category, found in 58% of cases”
    • Monitoring — overtly controlling a victim’s use of devices, or checking their messages — “featured in 40% of all cases”
    • Surveillance — covert use of technology to track or record — “featured in a third”
    • Deception — creating fake accounts, or falsifying messages or evidence — “was present in 15% of cases”
    • Restricting access to technology — destroying devices, changing passwords to lock victims out of accounts, preventing them calling for help — in “44% of cases”

    In five cases, the analysis found technology was used to facilitate or conceal the killing itself: perpetrators falsified messages from victims after their deaths, or used surveillance technology to locate them beforehand.

    Not recorded as a risk

    The finding the analysis returns to is what happened when victims reported it.

    In the case of Alice Ruggles, murdered in Gateshead in 2016 after a campaign of stalking that included her social media being hacked, police advised her to block the perpetrator, turn off her phone and delete her social media accounts. No technology-facilitated abuse was taken into account in the risk assessments carried out into her safety.

    In a Dorset case from 2021, in which the review gave the victim and perpetrator the pseudonyms Daisy and Robert, there was no documented physical violence between them. She reported his messages to police one lunchtime and was asked to confirm that she had told him to stop and had blocked his number. Her report was placed in a queue. No officer had attended when, 23 hours later, he entered her home and killed her.

    What the specialists said

    Emma Pickering, head of technology-facilitated abuse and economic empowerment at the charity Refuge, said the findings were likely “the tip of the iceberg”, and that officers “can be slow or reluctant to obtain evidence directly from perpetrators’ devices”. Police forces, she said, need to be resourced “to investigate tech-facilitated crime and secure digital evidence in a timely and effective manner”.

    Refuge research in 2021 found that one in three women in the UK had experienced online abuse, one in six of them at the hands of a partner or former partner — which the charity puts at almost two million women. Its own client figures show a 258 per cent rise in technology-facilitated abuse between 2018 and 2022. Pickering said Refuge has since seen a rise in reports involving wearable technology, hidden cameras and microphones.

    Jen Reed, head of policy at University College London’s gender and tech research lab, said the findings showed technology had “transformed the way perpetrators commit abuse”. Such abuse is “increasingly normalised, with many people not recognising this form of abuse early enough”, she said, and survivors who seek help “are not always taken as seriously as they may be for other forms of abuse”.

    The data stops in 2022

    The most recent death in the published reviews occurred in 2022. Pickering noted that technology has moved on since, “including the unregulated development of AI”.

    The analysis therefore predates the period in which AI-generated sexual imagery became widely available — and predates every development this publication has reported this month.

    Six days earlier, a scoping review published in PLOS One had found that evidence on escalation from online abuse to offline violence “remains extremely limited”, identifying a single study tracing that progression among the research it examined for sub-Saharan Africa. The two documents measure different things in different places. Read together, they suggest the evidence base is thin because few have looked.

  • Sexual deepfake apps on Apple’s App Store, research finds

    Sexual deepfake apps on Apple’s App Store, research finds

    Updated on Aug. 20

    Nearly 50 apps on Apple’s App Store were found to deliver sexually explicit face- and body-swapping once installed, according to research published by Copyleaks, an AI-detection company.

    Apple, responding to a request for comment from Unbowed, said only three examples were provided by Copyleaks in its article and all had been removed on July 29, two weeks before Copyleaks released its report. It had no record of Copyleaks reporting any of the apps to Apple.

    Apple said App Review Guidelines specifically prohibit overtly sexual or pornographic content, including ‘nudification’ apps and that the App Review team works round the clock to keep the App Store a safe and trusted place.

    Copyleaks’ research describes listings that disclose no sexual capability. The advertising that brings users to those listings runs on TikTok. And a number of the apps block screenshots and screen recording, which makes it harder for researchers or journalists to document what the apps actually generate, it says.

    Copyleaks says its researchers reviewed the apps over a six-month period.

    TikTok did not immediately respond to a request for comment.

    What the research describes

    Every app reviewed promoted benign features in its App Store listing, Copyleaks said, and none disclosed that it could generate sexualised imagery. Users encountered the explicit features only after downloading. The company said several user reviews came from people who had downloaded an app on the strength of its description and found the sexual content afterwards, including one reviewer who identified themselves as under 18.

    Almost all the apps operated on subscription or virtual-credit models, with sample templates viewable free and generation requiring payment. Some, Copyleaks said, may not work at all: several appeared to rely on pre-recorded or wholly synthetic material rather than processing uploaded photographs, and reviews reported apps that stopped functioning after payment.

    The finding with the widest implications concerns discovery. Virtually all the apps were found through advertisements on TikTok, Copyleaks said, and the advertisements were sexual in nature. In several cases, the company said, they explicitly promoted non-consensual use.

    “There is virtually no barrier to entry for these services anymore,” Copyleaks chief executive Alon Yamin said in the research.

    Apple said that when its App Review team identified malicious and fraudulent apps, they were analyzed in order to strengthen detection models. It noted that customers can visit https://reportaproblem.apple.com to report offensive, illegal, or abusive content, as well as scams or fraudulent activity on the App Store.

    The end of the chain

    The Independent also reported that it had found apps on Apple’s App Store offering to “strip” uploaded photographs.

    That app listed dozens of generated scenarios into which a user could place a photograph of a real person, the paper reported, including one labelled “bedroom rape”, each illustrated with graphic video.

    The app was removed after the publication flagged it to Apple, it said. Apple declined to comment directly but pointed to guidelines prohibiting overtly sexual or pornographic content, and said a number of the apps flagged to it had added violating features after being reviewed — which, if correct, describes a review process that inspects an app once and not again.

    Janaya Walker, interim director of the End Violence Against Women Coalition, told the Independent that such material allowed users to “role play violent and dehumanising acts against women” and had a “desensitising effect”, and that images created this way were “directly used to intimidate, threaten and harass women”. She called for legally binding safety-by-design requirements on platforms.

    Regulation shortfall

    The Online Safety Act reaches TikTok. By Ofcom’s account, it does not reach the App Store.

    Asked by the Independent about generative AI pornography sites and apps, an Ofcom spokesperson said the regulator was “actively assessing” their compliance with the Act and would “not hesitate” to act on failings. The spokesperson then added: “We have no powers to regulate app stores at present, but have been tasked with assessing the role they play in children encountering harmful content. We will report our findings later this year.”

    Updated on Aug. 20 at 11.09 a.m. ET with comment from Apple

  • British MP asks High Court to stop Grok generating images of her

    British MP asks High Court to stop Grok generating images of her

    A British member of parliament has asked the High Court to order Elon Musk’s xAI to stop its Grok chatbot generating sexualised images of her, in what her lawyers describe as the first claim of its kind in the United Kingdom over non-consensual AI-generated sexual content.

    Jess Asato, the Labour MP for Lowestoft, filed the request on 28 July 2026, according to the legal news service JURIST. It seeks a compliance order under section 167 of the Data Protection Act 2018 requiring xAI to delete every copy of the images and to implement what the filing calls effective and permanent technical measures, so that Grok can no longer generate images of her or train on her data.

    The underlying claim was filed in June in the King’s Bench Division’s Media and Communications List under claim number KB-2026-002373. It pleads misuse of private information alongside breaches of the UK General Data Protection Regulation and the Data Protection Act 2018, and names xAI as the controller responsible for how Grok was designed, trained and instructed.

    Central to the pleaded case is Grok’s system prompt — the standing instruction given to the model. Asato’s lawyers allege it told the model it had “no restrictions on adult sexual content or offensive content” and to “assume good intent”, so that it processed requests other chatbots refuse. The pleading further alleges xAI weakened earlier safety filters and, from around 9 January 2026, moved a “spicy mode” behind a paid subscription. These are allegations in a pleading, not findings of a court.

    Asato was targeted after criticising the company publicly. On 6 January she posted that using artificial intelligence to strip women without consent was “sexual assault designed to degrade and humiliate”. From around 11 January, users began prompting Grok to produce sexualised images of her.

    She seeks a declaration, damages including aggravated damages, and compensation under the UK GDPR.

    The claim invokes section 66E of the Sexual Offences Act 2003, which since February 2026 has made creating a non-consensual intimate image an offence in England and Wales. Ofcom has a separate formal investigation open into X.

    xAI has not filed a defence. It did not respond to a request for comment from JURIST.