{"id":402614,"date":"2025-06-25T12:33:24","date_gmt":"2025-06-25T12:33:24","guid":{"rendered":"https:\/\/belux.edmo.eu\/implementing-the-eu-code-of-practice-on-disinformation-an-evaluation-of-vlopse-compliance-and-effectiveness-jan-jun-2024\/"},"modified":"2025-10-02T12:40:08","modified_gmt":"2025-10-02T12:40:08","slug":"implementing-the-eu-code-of-practice-on-disinformation-an-evaluation-of-vlopse-compliance-and-effectiveness-jan-jun-2024","status":"publish","type":"post","link":"https:\/\/belux.edmo.eu\/lb\/implementing-the-eu-code-of-practice-on-disinformation-an-evaluation-of-vlopse-compliance-and-effectiveness-jan-jun-2024\/","title":{"rendered":"Implementing the EU Code of Practice on Disinformation: An Evaluation of VLOPSE Compliance and Effectiveness (Jan\u2013Jun 2024)"},"content":{"rendered":"

[vc_row][vc_column][vc_column_text css=””]<\/p>\n

\n
\n

Executive Summary<\/strong><\/h4>\n

\u00a0<\/strong>In recent years, the European Union has stepped up its efforts to counter disinformation, with the\u00a0Code of Practice on Disinformation (CoPD)<\/strong>\u00a0serving as a cornerstone of its approach. Originally introduced in 2018 and revised in 2022, the CoPD is a self-regulatory framework guiding Very Large Online Platforms and Search Engines (VLOPSE) in their obligations to reduce the spread and impact of disinformation. As of July 1, 2025, the Code will become effective as a formal\u00a0Code of Conduct\u00a0<\/strong>under the\u00a0Digital Services Act<\/strong>.<\/p>\n

This report evaluates the implementation of the CoPD between January and June 2024, focusing on the actions reported by\u00a0Meta (Facebook and Instagram), Google (Search and YouTube), Microsoft (Bing and LinkedIn),\u00a0<\/strong>and\u00a0TikTok.<\/strong>\u00a0Large online platforms are required to submit transparency reports twice a year, detailing their efforts to meet commitments under the Code. This report focuses on certain key areas such as\u00a0improving transparency, supporting media literacy, enhancing fact-checking partnerships, and enabling research.<\/em><\/p>\n

The assessment examines the extent to which these seven VLOPSEs\u2019 services have met core commitments under the CoPD and evaluates the real-world impact of selected actions and initiatives taken under the Code. This report aims to establish an evidence-based benchmark for evaluating platforms\u2019 compliance with the Code\u2019s requirements and the effectiveness of their efforts. It identifies both successes and shortcomings, offering a foundation for the continued evolution of policy and future improvements in transparency and accountability measures.<\/p>\n

The evaluation draws on multiple sources: transparency reports submitted in 2024, independent verification by EDMO researchers, and qualitative insights from a survey with experts. The analysis evaluates the progress of the VLOPSEs\u00a0across eight key commitments under three pillars of the CoPD:<\/strong><\/p>\n

Empowering Users<\/strong><\/p>\n

    \n
  • Commitment 17: Media literacy initiatives<\/li>\n
  • Commitment 21: Tools to help users identify disinformation<\/li>\n<\/ul>\n

    Empowering the Research Community<\/strong><\/p>\n

      \n
    • Commitment 26: Access to non-personal, anonymized data<\/li>\n
    • Commitment 27: Governance for sensitive data access<\/li>\n
    • Commitment 28: Cooperation with researchers<\/li>\n<\/ul>\n

      Empowering the Fact-Checking Community<\/strong><\/p>\n

        \n
      • Commitment 30: Cooperation with fact-checkers<\/li>\n
      • Commitment 31: Fact-checking integration in services<\/li>\n
      • Commitment 32: Access to relevant information for fact-checkers<\/li>\n<\/ul>\n
        Methodology<\/h5>\n

        The research, conducted by EDMO researchers from different Hubs, involved reviewing transparency reports submitted by platforms, cross-referencing claims with external sources, and documenting areas where verification was not possible. Qualitative insights were drawn from a survey distributed among media literacy experts, fact-checkers, and disinformation researchers affiliated or collaborating with EDMO. Together, these methods provide a comprehensive perspective on platform performance and accountability. Notably, this is the first initiative of its kind to combine self-reported platform data with independent verification and external expert evaluation.<\/p>\n

        The report is organized into three parts. First, when assessing\u00a0Compliance<\/em>, EDMO researchers examined whether platforms\u2019 transparency reports contain comprehensive and detailed accounts of their disinformation mitigation efforts. These self-reported measures were evaluated using a standardized scale, based on a defined\u00a0set of indicators<\/em>\u00a0(see\u00a0Annex A<\/em>). The reliability of the platforms\u2019 claims was assessed through cross-referencing with external sources, including public reports and input from EDMO colleagues and collaborators, where their expertise was applicable.<\/p>\n

        Second, the basis of assessing\u00a0Effectiveness<\/em>\u00a0is an expert survey with affiliated media literacy experts, fact-checkers, and researchers. The survey was conducted to gather\u00a0qualitative insights<\/em>\u00a0into how these efforts are perceived by professionals in the field (see\u00a0Annex C<\/em>). A total of 91 experts from 25 different countries took part in the survey, representing 14 EDMO Hubs.<\/p>\n

        Conducted between\u00a0December 2024 and February 2025, the survey was organized into the same thematic pillars: (1)\u00a0Media Literacy\/Empowering Users<\/em>, (2)\u00a0Research\/Empowering the Research Community<\/em>, and (3)\u00a0Empowering Fact-Checking<\/em>. Participants assessed the availability and relevance of over thirty measures\u2014ranging from digital-skills campaigns and in-app warnings to data-access protocols and independent verification tools\u2014and provided qualitative comments. These detailed insights were then cross-referenced with findings from transparency reports and expert feedback from EDMO\u2019s central team and individual Hubs, laying a robust foundation for evaluating platforms\u2019 performance and identifying gaps in support for media literacy or fact-checking, transparency, data sharing, and collaborative oversight.<\/p>\n

        Finally, the\u00a0Recommendations<\/em>\u00a0synthesize the findings from both the assessment of completeness and verifiability of platforms\u2019 reports and the expert survey feedback, offering policy recommendations aimed at improving the future implementation of the Code of Conduct and strengthening platform accountability.<\/p>\n

        Key Findings<\/h5>\n

        Effectiveness<\/strong><\/p>\n

        Overall, as regards the effectiveness of VLOPSE initiatives and actions, the expert Survey suggests that the efforts undertaken so far remain very limited, lacking consistency, and meaningful engagement (see\u00a0Table 1<\/em>). While some platforms, notably\u00a0Meta<\/strong>\u00a0and\u00a0Google<\/strong>, have launched initiatives to address disinformation, these are frequently criticized for being superficial or symbolic. In particular, some of\u00a0Meta<\/strong>\u2018s statements cast doubt on its future commitment and suggest a retreat from active collaboration. In every field, most VLOPSE tend to adopt a reactive rather than a proactive stance, with little transparency or structured support for users, fact-checkers and researchers. Even when formal agreements exist, their implementation often falls short of expectations. As a result, current efforts rarely translate into long-term, systemic support for counter-disinformation strategies.<\/p>\n<\/div>\n<\/div>\n

        \n
        \n
        \"EDMO<\/div>\n<\/figure>\n<\/div>\n
        \n
        \n

        It should be noted that, by its very nature, the analysis conducted in this report only provides insights regarding the effectiveness of platforms\u2019 measures as\u00a0perceived<\/em>\u00a0by a representative cross-section of relevant stakeholders (researchers, fact-checkers and civil society organisations), which is not necessarily indicative of the specific views of a single category of such stakeholders.<\/p>\n

        Compliance<\/strong><\/p>\n

        As regards the assessment of compliance, the analysis of the completeness and verifiability of transparency reports from the four major online platforms under the CoPD reveals a consistent trend of partial implementation, with uneven progress across key areas.<\/p>\n

        Empowering Users<\/em><\/p>\n

        Efforts to empower users through media literacy and content labeling (Commitment 17)<\/em>\u00a0vary considerably across platforms.\u00a0Meta<\/strong>\u00a0(Facebook<\/strong>\u00a0&\u00a0Instagram<\/strong>) demonstrates engagement with media literacy through initiatives such as\u00a0We Think Digital<\/em>\u00a0and in-app prompts. However, these efforts lack transparency regarding their geographical scope and provide no substantive data on user engagement or measurable outcomes at the national level.\u00a0Microsoft<\/strong>, through\u00a0Bing\u00a0<\/strong>and\u00a0LinkedIn<\/strong>, references partnerships with services like\u00a0NewsGuard<\/em>\u00a0and mentions participation in various campaigns, but offers no substantiated evidence of reach or effectiveness. These references come across as superficial, lacking any meaningful demonstration of impact. There are no user engagement figures, no reported outcomes, and no indication of the actual scale of these efforts.<\/p>\n

        Google<\/strong>\u2019s services (Search<\/strong>\u00a0and\u00a0YouTube<\/strong>) show greater structural commitment, notably through prebunking initiatives and features such as\u00a0\u201cMore About This Page.\u201d\u00a0<\/em>However, these efforts remain largely unaccountable, as\u00a0Google\u00a0<\/strong>provides no concrete data on user reach or effectiveness. While the initiatives appear well-designed in theory, the lack of transparency around their actual performance makes it impossible to assess their real-world impact.<\/p>\n

        TikTok\u00a0<\/strong>presents a more promising case, documenting a broader range of national campaigns and fact-checking partnerships. However, it still fails to provide country-specific detail or consistent engagement data. While it discloses limited behavioral indicators like share cancellation rates, it offers no comprehensive assessment of the overall impact of these interventions.<\/p>\n

        On tools to help users identify disinformation (Commitment 21<\/em>), all platforms rely on labels, panels, or warnings, but none are willing to detail their work.\u00a0Meta\u00a0<\/strong>reports maintaining a substantial fact-checking network and applying content labels such as \u201cFalse\u201d or \u201cPartly False.\u201d However, it provides little evidence of how these interventions affect user behavior, offering almost nothing beyond a single figure on interrupted reshares and a few isolated engagement statistics.\u00a0Microsoft\u00a0<\/strong>limits its efforts to commercial tools like\u00a0NewsGuard<\/em>\u00a0and unspecified AI-based detection, with no accompanying metrics.\u00a0Google\u00a0<\/strong>applies labeling mechanisms on both\u00a0Search\u00a0<\/strong>and\u00a0YouTube<\/strong>, reporting some aggregate reach data, but fails to present user impact or behavior change metrics.\u00a0TikTok<\/strong>\u00a0combines labeling with user notifications and provides partial insights into user behavior, such as share cancellation rates, although comprehensive evaluations remain absent.<\/p>\n

        Empowering the Research Community<\/em><\/p>\n

        Regarding access to non-personal, anonymized data (Commitment 26)<\/em>, all platforms make at least nominal provisions, but the quality and transparency of these efforts diverge.\u00a0Meta\u00a0<\/strong>provides data access via the ICPSR (University of Michigan) but fails to disclose national-level usage or uptake metrics.\u00a0Microsoft\u00a0<\/strong>references beta programs without clear evidence of researcher access or data granularity.\u00a0Google\u00a0<\/strong>makes several research tools available, yet their utility for disinformation-specific studies remains limited.\u00a0TikTok<\/strong>\u00a0appears to make more progress in this category, offering a Research API and dashboards with documented application processes and publicly available uptake metrics by Member State, even though the usability of the provided tools remains unclear.<\/p>\n

        Governance for sensitive data access (Commitment 27<\/em>) represents a weak point across all platforms.\u00a0Meta, Microsoft<\/strong>, and\u00a0Google\u00a0<\/strong>reference pilot programs but provide no substantive public documentation on governance frameworks or participant outcomes.\u00a0TikTok<\/strong>\u2019s participation in the EDMO data access pilot is acknowledged, though no conclusive evidence is provided regarding the effectiveness or transparency of these governance efforts.<\/p>\n

        In terms of cooperation with researchers (Commitment 28<\/em>),\u00a0Meta<\/strong>\u00a0claims to offer various tools, yet the allocation processes and prioritization criteria are opaque.\u00a0Microsoft<\/strong>\u00a0demonstrates minimal engagement in this area, lacking structured programs or support mechanisms.\u00a0Google\u00a0<\/strong>presents more comprehensive support through EMIF funding and affiliated research initiatives but is similarly hampered by governance and transparency gaps.\u00a0TikTok\u00a0<\/strong>offers extensive documentation and structured resources, but the complexity of its application procedures continues to limit effective access.<\/p>\n

        Empowering the Fact-Checking Community<\/em><\/p>\n

        Cooperation with fact-checkers (Commitment 30<\/em>) shows varying degrees of commitment.\u00a0Meta\u00a0<\/strong>lists multiple activities and partnerships but offers no systematic evaluation of their impact.\u00a0Microsoft\u00a0<\/strong>provides only minimal and vague references to cooperation. In contrast,\u00a0Google\u00a0<\/strong>describes well-integrated processes, including testing methodologies and financial support through EMIF, albeit without exhaustive metrics.\u00a0TikTok\u00a0<\/strong>similarly lists partnerships and fact-checking processes but does not provide sufficient evidence of their effectiveness or external validation.<\/p>\n

        The integration of fact-checking into services (Commitment 31<\/em>) shows similar patterns.\u00a0Meta\u00a0<\/strong>claims to apply labels and reduce content visibility but lacks detailed reporting on effectiveness.\u00a0Microsoft\u00a0<\/strong>provides no meaningful reporting on fact-checking integration.\u00a0Google\u00a0<\/strong>demonstrates a more systematic approach, employing panels and A\/B testing to assess effectiveness.\u00a0TikTok\u00a0<\/strong>applies labels but does not clearly articulate the impact on users or content creators.<\/p>\n

        Finally, access to relevant information for fact-checkers (Commitment 32<\/em>) remains poorly documented across all platforms.\u00a0Meta\u00a0<\/strong>mentions internal dashboards but provides no external verification or measurable data.\u00a0Microsoft\u00a0<\/strong>fails to report any dedicated tools or interfaces for fact-checkers.\u00a0Google\u00a0<\/strong>does not describe any specific mechanisms for information sharing.\u00a0TikTok\u00a0<\/strong>references the availability of dashboards but admits to limited depth and a lack of systematic external validation. Annex B summarizes in greater detail each platform\u2019s actions with the critical commitments selected for analysis.<\/p>\n

        Overall, compliance of VLOPSE with the selected commitments of the\u00a0Code of Practice on Disinformation\u00a0<\/em>remains inconsistent (see\u00a0Table 2<\/em>).<\/p>\n<\/div>\n<\/div>\n

        \n
        \n
        \"EDMO<\/div>\n<\/figure>\n<\/div>\n
        \n
        \n

        While some reported actions are supported by independent evidence, many lack transparency or verifiable data. Although platforms like\u00a0Google\u00a0<\/strong>and\u00a0TikTok<\/strong>\u00a0demonstrate more structured approaches in certain areas, none provide full transparency, independent verification, or robust impact reporting.\u00a0Meta\u2019<\/strong>s efforts are undermined by poor disclosure and the absence of meaningful impact data. While\u00a0Microsoft<\/strong>\u2019s performance is particularly weak across all commitments, this result should be considered in connection with the specific risk-profile of its services. Strengthening the enforcement of reporting requirements and mandating independent audits are essential steps toward improving the accountability and effectiveness of VLOPSEs\u2019 commitments to implement the future Code of Conduct.<\/p>\n<\/div>\n<\/div>\n

        [\/vc_column_text]