Critical reviewResearch writingComputer science

Ethics and security in AI and machine learning: a critical review of a narrative review, and what a stronger review would do

Surveys that cover AI ethics and AI security in one sweep are common and help readers get their bearings. This review looks at one such article, tests how much a narrative review can support its conclusions, sets it against research published from 2024 to 2026, and shows how a doctoral literature review on the topic can become more rigorous and more original.

What you will learn

  • Describe the scope of a narrative review on ethics and security in AI and machine learning
  • Evaluate what a narrative review can and cannot establish compared with a systematic or scoping review
  • Distinguish ethical risks (bias, opacity, privacy) from security threats (adversarial, privacy and data attacks) and see where they meet
  • Relate principles-based AI ethics to regulation, auditing and technical safeguards
  • Use recent taxonomies, such as the NIST adversarial machine learning taxonomy, to structure a review of AI security
  • Explain how large language models have changed the bias and security questions a current review must answer
  • Plan a more rigorous literature review on AI ethics or security for your own doctorate

What you will unlearn

  • AI ethics is mainly a matter of agreeing on principles.Principles converge widely, but turning them into methods, audits and accountability is the harder and less settled problem.
  • Security and ethics are separate topics.Attacks such as membership inference are privacy harms, and poisoned or biased data can produce unfair outcomes, so the two overlap.
  • A literature review that cites well-known papers is rigorous.Rigour comes from a stated search, selection and appraisal process that others could repeat.
  • Bias in AI comes only from biased data.Bias can also arise from the choice of target variable, the model, and how outputs are used in decisions.
  • Poisoning a training set is a laboratory curiosity that needs insider access.Researchers have shown that web-scale datasets could be poisoned cheaply by outsiders, so data provenance is now a practical security concern.

Skills you will practise

  • Critical appraisal
  • Review methodology
  • AI ethics frameworks
  • Machine learning security
  • Research gap identification
  • Regulatory awareness

The source and why it matters

This review examines "Ethics and security in artificial intelligence and machine learning: Current perspectives in computing", an article in the open-access journal INJOSER. The article reports no new data. Instead, it gathers published work on the ethical and security problems that AI and machine learning systems create in fields such as healthcare, finance, education and cybersecurity.

The pairing of ethics and security is worth taking seriously, because the two concerns increasingly collide. When a model reveals information about the people in its training data, that is a security breach and a privacy harm at once. When crafted inputs can steer a system, nobody can rely on it to treat people fairly. Bertino et al. (2021) capture this two-way link with the phrase "AI for security and security for AI". Doctoral researchers in computing often have to cover both themes in a literature review, a proposal or an ethics section, which makes the construction of a review like this one worth studying closely.

Ethics and Security in AI and ML
Figure 1. Ethics and security in AI and ML.

What the article covers

According to the earlier review of it, the article is arranged around two clusters of issues. The ethical cluster covers algorithmic bias and discrimination, the opacity of model decisions, and threats to privacy. The security cluster covers adversarial attacks, data manipulation and the misuse of generative techniques such as deepfakes. Among its sources are the overview of AI ethics by Huang et al. (2022), the account of AI and security by Bertino et al. (2021), and the discussion of AI security in future 6G networks by Siriwardhana et al. (2021).

The article concludes that responsible AI needs several things working together: regulation, transparent algorithms, effective security measures and cooperation among developers, users and regulators. Fairness, accountability and transparency serve as its organising values.

How far those conclusions can be trusted depends on method. The article is a narrative review, meaning that it synthesises a selection of the literature without saying how sources were searched for, chosen or appraised. Narrative reviews are a recognised and legitimate genre and work well as an introduction to a field. They cannot, however, make the same claims as systematic or scoping reviews (Grant & Booth, 2009).

Strengths

  • Breadth. Covering ethics and security in one piece lets readers notice overlaps that a specialist review of either area might miss.
  • Cross-sector framing. Examples drawn from health, finance, education and cybersecurity show the same risks recurring in settings where the stakes differ.
  • Accessible synthesis. A newcomer can use an overview like this to locate the main themes and the authors who shaped them.
  • A practical conclusion. The call to combine regulation, transparency and security engineering fits the direction that policy has since taken.

Limitations and methodological issues

Search and selection are not reported

No search strategy, inclusion criteria or source appraisal is given, so a reader cannot judge whether the literature discussed is representative or was chosen to suit the argument. Computing already has established guidance for systematic reviews (Kitchenham & Charters, 2007), and PRISMA 2020 lists what a transparent review should report (Page et al., 2021). A narrative review does not have to meet these standards in full. Even a brief note on databases, date ranges and selection principles, though, would let readers weigh its claims.

Problems receive more space than solutions

Concrete work on mitigation is plentiful. Differential privacy sets formal limits on what a model can reveal about any individual (Dwork & Roth, 2014). Studies of membership inference measure how much trained models leak (Nasr et al., 2019). Datasheets document how training data were gathered and what uses they suit (Gebru et al., 2021). For high-stakes decisions, an interpretable model may serve better than a black box explained after the event (Rudin, 2019). Newer work, discussed below, adds systematic catalogues of attacks and defences that make this gap easier to close (Vassilev et al., 2025; Gallegos et al., 2024).

Principles without the debate about principles

The article appeals to fairness, accountability and transparency but does not engage with research on AI ethics principles as such. Jobin et al. (2019) analysed 84 ethics guidelines and found convergence on a small set of principles, chiefly transparency, justice and fairness, non-maleficence, responsibility and privacy, alongside disagreement over how to interpret and apply them. Mittelstadt (2019) argued that principles cannot guarantee ethical AI on their own, because AI development lacks the shared aims, professional norms, proven methods and accountability mechanisms that give principles force in medicine. Any review that recommends principle-based governance needs to answer this objection, and auditing research now offers one way to do so (Laine et al., 2024).

Evidence for harms is general rather than specific

A claim about bias carries more weight when it rests on a documented case. Obermeyer et al. (2019) showed that a widely used healthcare algorithm, which treated health costs as a stand-in for health needs, gave Black patients the same risk scores as white patients who were less ill. The case shows that bias can enter through the choice of target variable and not only through the data, and drawing out mechanisms of this kind is what a review should do.

Ethics and security sit side by side rather than together

Treating ethics and security in a single review is the article's most promising move, and also where it stops short. The two sets of issues run largely in parallel. An integrated analysis would look for the points of contact: an attack on training data that produces unfair outcomes, privacy protections that cost accuracy for small groups, or transparency demands that expose a model to attack. Design decisions are hardest at these trade-offs, and a review adds most value there, because neither the ethics literature nor the security literature settles them alone.

Several sources, finally, are forward-looking position papers or short conference contributions, such as the discussion of AI security in 6G networks (Siriwardhana et al., 2021). These help to flag emerging concerns, but they describe anticipated rather than observed risks, and a review should make that distinction visible.

How the article sits in the wider literature

Regulation has moved fast since many of the article's sources appeared. The EU Artificial Intelligence Act follows a risk-based model: it bans some practices, sets requirements for high-risk systems that include accuracy, robustness and cybersecurity, and imposes transparency duties for certain generated content (European Parliament & Council of the European Union, 2024). A current review would test its recommendations against this framework instead of calling for regulation in general terms.

The security literature also contains a methodological strand that a review could put to use. Arp et al. (2022) identified recurring pitfalls in machine learning for computer security research, among them sampling bias, data snooping and inappropriate baselines, each of which can make reported results look stronger than they are. For a doctoral researcher these pitfalls matter as much as the threats, because they set how much confidence the evidence deserves.

Linking ethical and security concerns to safeguards and evidence
ConcernExample of the riskExamples of safeguardsKey source
Bias and discriminationProxy target that disadvantages a groupAudit target variables; test outcomes across groups(Obermeyer et al., 2019)
OpacityHigh-stakes decisions from models no one can explainPrefer interpretable models where stakes are high(Rudin, 2019)
Privacy leakageMembership inference against trained modelsDifferential privacy; restricted model access(Nasr et al., 2019; Dwork & Roth, 2014)
Undocumented dataModels used outside the conditions their data reflectDatasheets describing collection and limits(Gebru et al., 2021)
Weak evaluationSecurity results inflated by data snooping or sampling biasRealistic splits, baselines and threat models(Arp et al., 2022)
GovernancePrinciples not translated into practiceRisk-based legal obligations; accountability mechanisms(European Parliament & Council of the European Union, 2024; Mittelstadt, 2019)

What newer research adds (2024 to 2026)

Work published since 2024 changes the picture in three ways. Large language models have become the main object of study, security research now has shared taxonomies, and governance research has moved from listing principles to asking how they can be audited. The table summarises verified studies and reports that bear on the reviewed article.

Selected 2024 to 2026 evidence relevant to the reviewed article
StudyDesign and dataKey findingWhat it means for the reviewed paper
Carlini et al. (2024)Attack study on web-scale image-text training datasetsTwo practical poisoning attacks, one exploiting web content that changes between curation and download, one exploiting timed edits to crowd-sourced sources; 0.01% of LAION-400M or COYO-700M could have been poisoned for about USD 60Data manipulation is a present, low-cost threat, so a review should treat data provenance as a core safeguard
Vassilev et al. (2025)Official taxonomy built from a survey of the adversarial machine learning literatureClassifies attacks on predictive and generative AI by attacker goals (availability, integrity, privacy), capabilities, knowledge and lifecycle stage, with matching mitigations and open challengesOffers a ready structure for the security half of a review, replacing ad hoc lists of threats
Gallegos et al. (2024)Survey of bias evaluation and mitigation for large language modelsThree taxonomies: metrics by the level at which they operate, datasets as counterfactual inputs or prompts, and mitigation by stage from pre-processing to post-processingBias in generative models needs its own measures; general fairness language is no longer enough
Das et al. (2025)Survey of security and privacy challenges of large language modelsReviews jailbreaking, data poisoning and leakage of personally identifiable information, risks in domains such as education and healthcare, and defencesConfirms the security-privacy overlap the paper gestures at, now for the systems most people use
Laine et al. (2024)Systematic literature review of 93 studies on ethics-based AI auditingFairness was the most discussed principle (84 studies), then transparency (54), non-maleficence (41) and responsibility (39); most work is social and process-orientedAuditing is one route from principles to practice that the paper does not discuss
Bengio et al. (2024)Policy Forum by 20 researchers in ScienceArgues that preparing for risks from advanced AI requires technical research and development as well as adaptive, proactive governanceSupports the call for combined technical and regulatory action, while raising the stakes
Bengio (2025)International report by 96 experts, backed by 30 countries, the UN, EU and OECDFinds that the best available risk-management techniques still have highly significant limitations and offer no quantitative guarantees; current interpretability methods remain severely limitedCautions against any review that presents safeguards as a solved problem

Much of this work confirms the article's starting point. The overlap between ethics and security is now well documented: surveys of large language models place privacy leakage and data poisoning beside jailbreaking as linked failures (Das et al., 2025), and poisoning research shows that the integrity of training data, which shapes both fairness and safety, can be undermined by outsiders at modest cost (Carlini et al., 2024). The article's closing call for regulation and security engineering together is also echoed by senior researchers (Bengio et al., 2024).

Other findings challenge the article, or at least its level of detail. The NIST taxonomy shows that the security literature is mature enough to be organised systematically, so a review that lists threats without a framework now looks dated (Vassilev et al., 2025). Research on bias in language models has developed its own metrics and mitigation stages (Gallegos et al., 2024), which means general appeals to fairness no longer reflect the field. The international safety report, meanwhile, warns that safeguards remain partial (Bengio, 2025), a caution that sits awkwardly with confident recommendations.

Several questions are still open. Auditing research has grown, yet it concentrates on social and process aspects and says less about technical verification (Laine et al., 2024). Evidence on how well defences hold up in deployed systems is thin, and the trade-offs between fairness, privacy and robustness that the article leaves unexamined are still under-studied. These are promising areas for doctoral work.

What it means for doctoral researchers

A broad narrative review is a good place to start reading, but a doctoral literature review must go further. Pick the review type that fits your purpose (Grant & Booth, 2009): a scoping review to map a wide field, a systematic review to answer a focused question, or a critical review to build a conceptual argument. Report how you searched for and selected sources even when the review is not fully systematic, and narrow the scope until you can examine mechanisms and safeguards in depth.

The newer literature also gives you ready-made structure. You can organise security threats with the NIST taxonomy (Vassilev et al., 2025), bias in language models with the categories of Gallegos et al. (2024), and governance with the auditing literature (Laine et al., 2024). Because these frameworks are already in use, adopting one makes your review easier to compare with others and shows examiners that you know the current state of the field. Check the date coverage of every review you rely on, since anything written before 2024 will miss most work on large language models.

Whatever review you read in this area, this one included, a short set of questions helps you decide how much weight it deserves. How were the sources found and chosen? Are harms backed by documented cases, or simply asserted? Are safeguards described together with evidence of how well they work? Is the regulatory discussion current? And does the review explain where ethical and security goals conflict?

Worked example (illustrative)

Consider a doctoral researcher interested in "AI ethics and security in healthcare" who starts from a narrative review like this one. She narrows the topic to privacy attacks on clinical prediction models and frames a focused question: which defences have been evaluated on real clinical data? She searches named databases with a recorded search string and date, classifies each study's threat model with the NIST taxonomy (Vassilev et al., 2025), screens studies against stated criteria, and notes evaluation pitfalls of the kind described by Arp et al. (2022). She then maps the defences she finds to the relevant legal requirements. Her gap is specific: few defences have been tested on clinical data under realistic threat models. The example is hypothetical, but it shows how a broad overview turns into a researchable question; see also research gap identification.

Common mistakes in literature reviews on AI ethics and security

  • Listing risks such as bias, privacy and adversarial attacks without explaining the mechanisms behind them.
  • Citing ethics principles without discussing how, or whether, they are put into practice.
  • Leaving out how sources were found and selected, so the review cannot be assessed or updated.
  • Treating regulation generically instead of engaging with specific, current legal frameworks.
  • Accepting reported security results without checking how the evaluation was designed.
  • Relying on reviews written before 2024 and so overlooking work on large language models.
  • Covering so many sectors and threats that no single issue is analysed in depth.

Key takeaways

Your next step

Want to apply this to your own study?

  1. 1Tell us your topic, data and deadline
  2. 2A subject mentor reviews your work with you
  3. 3You get a plan and a quote
Research gap identification

References

  1. Arp, D., Quiring, E., Pendlebury, F., Warnecke, A., Pierazzi, F., Wressnegger, C., Cavallaro, L., & Rieck, K. (2022). Dos and don'ts of machine learning in computer security. In Proceedings of the 31st USENIX Security Symposium (pp. 3971–3988). USENIX Association. https://www.usenix.org/conference/usenixsecurity22/presentation/arp
  2. Bengio, Y. (Chair). (2025). International AI safety report (DSIT 2025/001). Department for Science, Innovation and Technology. https://internationalaisafetyreport.org/publication/international-ai-safety-report-2025
  3. Bengio, Y., Hinton, G., Yao, A., Song, D., Abbeel, P., Darrell, T., Harari, Y. N., Zhang, Y.-Q., Xue, L., Shalev-Shwartz, S., Hadfield, G., Clune, J., Maharaj, T., Hutter, F., Baydin, A. G., McIlraith, S., Gao, Q., Acharya, A., Krueger, D., & Mindermann, S. (2024). Managing extreme AI risks amid rapid progress. Science, 384(6698), 842–845. https://doi.org/10.1126/science.adn0117
  4. Bertino, E., Kantarcioglu, M., Akcora, C. G., Samtani, S., Mittal, S., & Gupta, M. (2021). AI for security and security for AI. In Proceedings of the Eleventh ACM Conference on Data and Application Security and Privacy (pp. 333–334). Association for Computing Machinery. https://doi.org/10.1145/3422337.3450357
  5. Carlini, N., Jagielski, M., Choquette-Choo, C. A., Paleka, D., Pearce, W., Anderson, H. S., Terzis, A., Thomas, K., & Tramèr, F. (2024). Poisoning web-scale training datasets is practical. In 2024 IEEE Symposium on Security and Privacy (pp. 407–425). IEEE. https://doi.org/10.1109/SP54263.2024.00179
  6. Das, B. C., Amini, M. H., & Wu, Y. (2025). Security and privacy challenges of large language models: A survey. ACM Computing Surveys, 57(6). https://doi.org/10.1145/3712001
  7. Dwork, C., & Roth, A. (2014). The algorithmic foundations of differential privacy. Foundations and Trends in Theoretical Computer Science, 9(3–4), 211–407. https://doi.org/10.1561/0400000042
  8. European Parliament & Council of the European Union. (2024). Regulation (EU) 2024/1689 of 13 June 2024 laying down harmonised rules on artificial intelligence (Artificial Intelligence Act). Official Journal of the European Union, L 2024/1689. https://eur-lex.europa.eu/eli/reg/2024/1689/oj/eng
  9. Gallegos, I. O., Rossi, R. A., Barrow, J., Tanjim, M. M., Kim, S., Dernoncourt, F., Yu, T., Zhang, R., & Ahmed, N. K. (2024). Bias and fairness in large language models: A survey. Computational Linguistics, 50(3), 1097–1179. https://doi.org/10.1162/coli_a_00524
  10. Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé III, H., & Crawford, K. (2021). Datasheets for datasets. Communications of the ACM, 64(12), 86–92. https://doi.org/10.1145/3458723
  11. Grant, M. J., & Booth, A. (2009). A typology of reviews: An analysis of 14 review types and associated methodologies. Health Information & Libraries Journal, 26(2), 91–108. https://doi.org/10.1111/j.1471-1842.2009.00848.x
  12. Huang, C., Zhang, Z., Mao, B., & Yao, X. (2022). An overview of artificial intelligence ethics. IEEE Transactions on Artificial Intelligence. Advance online publication. https://ieeexplore.ieee.org/abstract/document/9844014/
  13. Jobin, A., Ienca, M., & Vayena, E. (2019). The global landscape of AI ethics guidelines. Nature Machine Intelligence, 1(9), 389–399. https://doi.org/10.1038/s42256-019-0088-2
  14. Kitchenham, B., & Charters, S. (2007). Guidelines for performing systematic literature reviews in software engineering (Technical Report EBSE 2007-001). Keele University and Durham University. https://www.scirp.org/reference/ReferencesPapers?ReferenceID=1555797
  15. Laine, J., Minkkinen, M., & Mäntymäki, M. (2024). Ethics-based AI auditing: A systematic literature review on conceptualizations of ethical principles and knowledge contributions to stakeholders. Information & Management, 61(5), Article 103969. https://doi.org/10.1016/j.im.2024.103969
  16. Mittelstadt, B. (2019). Principles alone cannot guarantee ethical AI. Nature Machine Intelligence, 1(11), 501–507. https://doi.org/10.1038/s42256-019-0114-4
  17. Nasr, M., Shokri, R., & Houmansadr, A. (2019). Comprehensive privacy analysis of deep learning: Passive and active white-box inference attacks against centralized and federated learning. In 2019 IEEE Symposium on Security and Privacy (pp. 739–753). IEEE. https://doi.org/10.1109/SP.2019.00065
  18. Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019). Dissecting racial bias in an algorithm used to manage the health of populations. Science, 366(6464), 447–453. https://doi.org/10.1126/science.aax2342
  19. Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., . . . Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372, Article n71. https://doi.org/10.1136/bmj.n71
  20. Rudin, C. (2019). Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, 1(5), 206–215. https://doi.org/10.1038/s42256-019-0048-x
  21. Siriwardhana, Y., Porambage, P., Liyanage, M., & Ylianttila, M. (2021). AI and 6G security: Opportunities and challenges. In 2021 Joint European Conference on Networks and Communications & 6G Summit (EuCNC/6G Summit) (pp. 616–621). IEEE. https://ieeexplore.ieee.org/abstract/document/9482503/
  22. Vassilev, A., Oprea, A., Hamin, M., Fordyce, A., Anderson, H., & Davies, X. (2025). Adversarial machine learning: A taxonomy and terminology of attacks and mitigations (NIST AI 100-2e2025). National Institute of Standards and Technology. https://doi.org/10.6028/NIST.AI.100-2e2025

How to cite this article

Choose your referencing style, then copy. Check your university's or journal's guide for local variations.

PhD Research Lab Academy. (2026, June 2). Ethics and security in AI and machine learning: a critical review of a narrative review, and what a stronger review would do. PhD Research Lab. https://www.phdassistance.com/academy/critical-review/ethics-and-security-in-ai-and-ml-review/

PhD Research Lab Academy. “Ethics and Security in AI and Machine Learning: A Critical Review of a Narrative Review, and What a Stronger Review Would Do.” PhD Research Lab, 2 June 2026, www.phdassistance.com/academy/critical-review/ethics-and-security-in-ai-and-ml-review. Accessed [access date].

PhD Research Lab Academy (2026) Ethics and security in AI and machine learning: a critical review of a narrative review, and what a stronger review would do. PhD Research Lab. Available at: https://www.phdassistance.com/academy/critical-review/ethics-and-security-in-ai-and-ml-review/ (Accessed: [access date]).

PhD Research Lab Academy. “Ethics and Security in AI and Machine Learning: A Critical Review of a Narrative Review, and What a Stronger Review Would Do.” PhD Research Lab. June 2, 2026. https://www.phdassistance.com/academy/critical-review/ethics-and-security-in-ai-and-ml-review.

PhD Research Lab Academy, ‘Ethics and Security in AI and Machine Learning: A Critical Review of a Narrative Review, and What a Stronger Review Would Do’ (PhD Research Lab, 2 June 2026) <https://www.phdassistance.com/academy/critical-review/ethics-and-security-in-ai-and-ml-review> accessed [access date].

PhD Research Lab Academy. Ethics and security in AI and machine learning: a critical review of a narrative review, and what a stronger review would do [Internet]. PhD Research Lab; 2026 Jun 2 [cited [access date]]. Available from: https://www.phdassistance.com/academy/critical-review/ethics-and-security-in-ai-and-ml-review/

PhD Research Lab Academy, “Ethics and security in AI and machine learning: a critical review of a narrative review, and what a stronger review would do,” PhD Research Lab, June 2, 2026. [Online]. Available: https://www.phdassistance.com/academy/critical-review/ethics-and-security-in-ai-and-ml-review. [Accessed: [access date]].

@online{ethics_and_security_in_ai_and_ml_review_2026,
  author = {{PhD Research Lab Academy}},
  title = {{Ethics and security in AI and machine learning: a critical review of a narrative review, and what a stronger review would do}},
  organization = {PhD Research Lab},
  date = {2026-06-02},
  url = {https://www.phdassistance.com/academy/critical-review/ethics-and-security-in-ai-and-ml-review},
  urldate = {[access date]}
}

This article is for learning. Use it to understand the method and cite the original sources above in your own work; do not copy or submit it as your own.

Ethics and security in AI and machine learningNeed help applying it to your study?
Research gap identification