Category: Platforms & AI

  • French helpline reports women filmed secretly by smart glasses

    French helpline reports women filmed secretly by smart glasses

    A French helpline says it has received around twenty reports since January from women who were filmed without their knowledge by people wearing camera glasses, with the footage then published on social media.

    The Association e-Enfance, which runs the national 3018 line for victims of online harassment and digital violence, said that the reports followed a consistent pattern. A content creator approaches a girl or a young woman in a public place — a street, a station, a park, a shopping centre — and films her without telling her. He then tries to provoke a reaction or deliberately puts her in an awkward position. The sequence is posted as a prank or a vox-pop.

    Publication is often the start of a second harm, the association said. Mockery, insults, hateful or misogynistic remarks and threats accumulate in the comments and in private messages.

    In one case it handled, a girl contacted the 3018 after being filmed at the Fête de la Musique in Paris by a man. He asked her questions that made her uncomfortable and followed her down the street until she answered. The video went viral. She then received hateful comments and death threats.

    Videos removed, then reposted

    The association is France’s first designated trusted flagger under the European Union’s Digital Services Act, a status granted by the media regulator Arcom that gives its reports priority handling by platforms.

    Several of the accounts involved belong to creators whose output consists of this kind of content, it said. When victims ask for videos to be taken down, the creators refuse. TikTok removed several of the videos the 3018 flagged, but some were put back online afterwards and the accounts remain active and are still posting.

    What Meta has changed

    Meta has tightened its safeguards. The glasses carry a light that shows when the camera is running, and the company has rolled out updates that disable the photo and video functions if that light is covered or damaged.

    Unbowed contacted Meta for comment.

    Meta told Semafor on 1 September that it had disabled the cameras on thousands of pairs after detecting tampering, and estimated that fewer than one in a thousand of the glasses it has sold had been interfered with. Alex Himel, its vice president of wearables, described the problem as “a little bit of a cat and mouse game” and said the company would “keep monitoring and evolving the measures that we have”.

    For the e-Enfance association, that does not solve the problem. Seeing a light does not mean consenting to having your image published, it said — and that assumes the person sees it, understands what it means and has any opportunity to react.

    “Victims cannot become the full-scale test of products whose abusive uses should have been better anticipated,” said Véronique Béchu, who directs the association’s observatory. “The rules governing these devices need to be revisited at the design stage. And when creators make a business out of humiliating strangers, platforms must apply zero tolerance and suspend repeat accounts.”

    The regulator said much the same in May

    France’s data protection authority, the CNIL, warned in May that the technical means of telling people they are being recorded — an indicator light, for example — have only limited effect, and that some uses have none at all.

    In a survey it commissioned in January of 2,128 people, 67 per cent said connected glasses posed a risk to privacy. The CNIL said the devices threatened a shift from surveillance that is fixed, signposted and regulated to surveillance that is mobile, almost invisible and everywhere, and has referred the question to the European Data Protection Board.

  • Google apologises as Korea weighs criminal complaint over victim data

    Google apologises as Korea weighs criminal complaint over victim data

    Google has issued a formal apology after the personal details of South Korean women who asked it to remove illegally filmed material of themselves were published on the website of an outside research institute.

    The company said it was “deeply and heavily aware of the profound hurt and pain experienced by the victims and the public as a result of this issue”, in a statement reported by the broadcaster SBS on Wednesday.

    It said that during its internal processing, “the principle that sensitive information, as well as any specific details, must never be shared with third-party research databases was not strictly upheld”.

    Google said it had activated an emergency response with the site and permanently deleted from its servers all material relating to the notices confirmed to have been exposed. It has stopped sending the site notices of new legal deletion requests filed in Korea, and has blocked past notices relating to Korean requests from being viewed externally.

    The apology has not settled the matter. The Ministry of Gender Equality and Family is considering bringing a criminal complaint against Google over the disclosure. Officials are examining whether the company breached the Act on Special Cases Concerning the Punishment of Sexual Crimes, the Telecommunications Business Act, the Information and Communications Network Act or the Personal Information Protection Act. Any complaint would be brought by the ministry or by the Korea Women’s Human Rights Institute.

    Google had earlier told the government that the sensitive information was passed on “due to an employee’s mistake”, according to the newspaper Hankook Ilbo, which did not attribute the remark directly. Hankyoreh, which reported the disclosure on Tuesday, described the company’s initial response as a “one-line apology”.

    What was published

    Google sends deletion requests to a collaborating research institute — described by Hankook Ilbo as a private body under Harvard University in the United States — for the stated purpose of analysing and researching them.

    The requests were written by women asking for material to be taken down. One read: my sexual video has been illegally leaked and the harm is serious, please delete the search terms that identify me.

    On the institute’s website, the newspaper reported, the requests appeared alongside the women’s names, ages, workplaces, schools and mobile telephone numbers, without being de-identified.

    Some of the requests had been sent not by the women themselves but on their behalf by the ministry and by the Broadcasting and Media Communications Standards Commission.

    Both bodies wrote to the institute asking for the material to be removed, and it was taken down on 7 September. The commission carried out deletion and blocking measures on about 200 items, of which 15 were reported to have exposed information identifying individuals. Hankook Ilbo reported the ministry as understanding the problematic exposed information to number at least 200 cases.

    The remedies Google has announced apply to Korean requests. It has not said whether requests made in other countries were exposed in the same way.

    Deletion requests suspended

    The consequence for victims is that the main route to getting material removed has been closed.

    The ministry’s Central Digital Sex Crime Victim Support Centre, which files deletion requests on victims’ behalf, stopped sending them to Google in mid-August and has suspended them indefinitely. The government’s position is that it cannot resume until the risk of further disclosure is resolved.

    “Not simple human error”

    The Citizens’ Coalition for Democratic Media, a South Korean media watchdog, said Google should not be allowed to treat the matter as human error.

    In a statement published on Tuesday, it said the company should establish exactly what information had been disclosed and how much, apologise to the victims, take responsibility for any further harm caused by the re-exposure, and change the way it shares information.

    It said the government should not simply wait for Google’s answer, and should restore the victim support work quickly while investigating how personal data is handled and shared externally.

    “A victim asking for illegally filmed material to be deleted, and becoming a victim again, must end here,” it said.

    Updated on 09/09/2026 with further details of statement

  • Sexual deepfake apps on Apple’s App Store, research finds

    Sexual deepfake apps on Apple’s App Store, research finds

    Updated on Aug. 20

    Nearly 50 apps on Apple’s App Store were found to deliver sexually explicit face- and body-swapping once installed, according to research published by Copyleaks, an AI-detection company.

    Apple, responding to a request for comment from Unbowed, said only three examples were provided by Copyleaks in its article and all had been removed on July 29, two weeks before Copyleaks released its report. It had no record of Copyleaks reporting any of the apps to Apple.

    Apple said App Review Guidelines specifically prohibit overtly sexual or pornographic content, including ‘nudification’ apps and that the App Review team works round the clock to keep the App Store a safe and trusted place.

    Copyleaks’ research describes listings that disclose no sexual capability. The advertising that brings users to those listings runs on TikTok. And a number of the apps block screenshots and screen recording, which makes it harder for researchers or journalists to document what the apps actually generate, it says.

    Copyleaks says its researchers reviewed the apps over a six-month period.

    TikTok did not immediately respond to a request for comment.

    What the research describes

    Every app reviewed promoted benign features in its App Store listing, Copyleaks said, and none disclosed that it could generate sexualised imagery. Users encountered the explicit features only after downloading. The company said several user reviews came from people who had downloaded an app on the strength of its description and found the sexual content afterwards, including one reviewer who identified themselves as under 18.

    Almost all the apps operated on subscription or virtual-credit models, with sample templates viewable free and generation requiring payment. Some, Copyleaks said, may not work at all: several appeared to rely on pre-recorded or wholly synthetic material rather than processing uploaded photographs, and reviews reported apps that stopped functioning after payment.

    The finding with the widest implications concerns discovery. Virtually all the apps were found through advertisements on TikTok, Copyleaks said, and the advertisements were sexual in nature. In several cases, the company said, they explicitly promoted non-consensual use.

    “There is virtually no barrier to entry for these services anymore,” Copyleaks chief executive Alon Yamin said in the research.

    Apple said that when its App Review team identified malicious and fraudulent apps, they were analyzed in order to strengthen detection models. It noted that customers can visit https://reportaproblem.apple.com to report offensive, illegal, or abusive content, as well as scams or fraudulent activity on the App Store.

    The end of the chain

    The Independent also reported that it had found apps on Apple’s App Store offering to “strip” uploaded photographs.

    That app listed dozens of generated scenarios into which a user could place a photograph of a real person, the paper reported, including one labelled “bedroom rape”, each illustrated with graphic video.

    The app was removed after the publication flagged it to Apple, it said. Apple declined to comment directly but pointed to guidelines prohibiting overtly sexual or pornographic content, and said a number of the apps flagged to it had added violating features after being reviewed — which, if correct, describes a review process that inspects an app once and not again.

    Janaya Walker, interim director of the End Violence Against Women Coalition, told the Independent that such material allowed users to “role play violent and dehumanising acts against women” and had a “desensitising effect”, and that images created this way were “directly used to intimidate, threaten and harass women”. She called for legally binding safety-by-design requirements on platforms.

    Regulation shortfall

    The Online Safety Act reaches TikTok. By Ofcom’s account, it does not reach the App Store.

    Asked by the Independent about generative AI pornography sites and apps, an Ofcom spokesperson said the regulator was “actively assessing” their compliance with the Act and would “not hesitate” to act on failings. The spokesperson then added: “We have no powers to regulate app stores at present, but have been tasked with assessing the role they play in children encountering harmful content. We will report our findings later this year.”

    Updated on Aug. 20 at 11.09 a.m. ET with comment from Apple

  • Nudify app ads still appearing on Instagram, campaigners say

    Nudify app ads still appearing on Instagram, campaigners say

    Advertisements for artificial intelligence tools that generate sexual images of real people without their consent are still running on Instagram, the campaign group Stop Online Harm said on Wednesday.

    The organisation said its team had investigated and found ads promoting tools that digitally remove clothing and produce sexually explicit images. The adverts it found offered to “undress” the subjects of photographs and showed women in sexually explicit positions, it said.

    Meta, which owns Instagram and Facebook, prohibits exactly this. Its Adult Sexual Exploitation community standard bars “promoting, threatening to share, or offering to make NCII or kissing imagery through applications or services (including AI), or instructions, even if there is no commercial or non-commercial imagery shared in the content (sometimes referred to as ‘nudify’ apps or ‘AI kissing’ apps)”. NCII stands for non-consensual intimate imagery.

    Stop Online Harm published its finding on LinkedIn.

    What has been documented

    A detailed account of nudify advertising on Meta’s platforms was published on 26 July by the Tech Transparency Project, a Washington-based non-profit that monitors large technology companies.

    Using Meta’s Ad Library — the disclosure database the company is required to maintain in the European Union under the Digital Services Act — the group traced a network of adverts to GatherOne, also trading as Hongkong Gather Wisdom, one of roughly a dozen Chinese agencies Meta authorises to place adverts on behalf of Chinese clients. Because China blocks both platforms, Chinese advertisers wanting to reach audiences abroad must in principle go through such an intermediary.

    The group identified 210 Facebook pages naming GatherOne in their advert disclosures, which between them ran about 30,800 adverts for face-swap and other AI apps. Of those pages, 43 ran more than 7,600 adverts for apps the researchers verified could nudify women. Multiple user reviews of one app flagged what appeared to be child sexual abuse material.

    Meta removed many of the adverts and disabled accounts during the investigation, the group said, but at least two dozen linked pages carried on advertising after having adverts taken down.

    Meta did not answer the Tech Transparency Project’s questions. In a statement to Bloomberg News, which reported the research, it said it takes “aggressive steps” against nudify apps and that advertisers who break its rules risk having adverts cancelled, being fined and having their accounts terminated. GatherOne told the researchers after publication that it had suspended new advertising accounts for AI nudify, face-swap and “girlfriend” services.

    Meta has not commented publicly on Stop Online Harm’s finding.

    Not the first time

    Meta sued Joy Timeline HK, the Hong Kong company behind the CrushAI nudify app, in June 2025, saying it had repeatedly evaded enforcement. Researchers had linked more than 87,000 adverts across over 135 Facebook pages to that app. A CBS News investigation separately found hundreds of nudify adverts running on Facebook and Instagram.

    Creating these images is now unlawful in a growing number of jurisdictions. Minnesota’s ban on tools that generate fake nude images took effect on 1 August after a federal judge refused xAI’s request to pause it.

    A poll published on 4 August by Women Who Tech and Rad Campaign, two organisations that campaign on the issue, found 67 per cent of American adults registered some or high concern about AI being used to create sexual imagery of women, and 71 per cent about deepfakes that sexualise children.

  • YouTube sent 1.8 million visits to nudify sites, research finds

    YouTube sent 1.8 million visits to nudify sites, research finds

    Mainstream social media platforms referred more than 5.7 million visits to websites and applications that generate non-consensual intimate images between December 2025 and March 2026, according to research published by the Institute for Strategic Dialogue.

    YouTube alone accounted for 1.82 million of those visits, more than 30 per cent of all referrals identified, the London-based research organisation found.

    The finding shifts attention from the tools themselves to the platforms that carry traffic to them. Regulatory action so far has concentrated on the applications and the app stores that distribute them. San Francisco’s city attorney wrote to Apple and Google in July over 13 named applications. Australia’s eSafety Commissioner has issued compliance directions to individual services.

    The Institute for Strategic Dialogue’s report, *Mapping the “Nudify” Tools Ecosystem*, is the outcome of a six-month project supported by the UK AI Safety Institute’s Challenge Fund. It traces how gendered deepfake content is created, circulated and sustained, and situates it within technology-facilitated gender-based violence, or TFGBV — abuse committed, assisted or amplified by digital tools and directed at people because of their gender.

    The report calls for what it describes as coordinated, system-wide responses spanning online, offline, hybrid and policy interventions, including increased platform regulation and funding for digital literacy workshops in schools.

    The research arrives as the European Union prepares to begin enforcing rules requiring AI-generated and altered content to be labelled, from 2 August. Those rules address disclosure rather than distribution, and would not on their face reach referral traffic of the kind the report describes.