Agentic AI Systems: A Taxonomy of Autonomy, Delegation and Accountability for Tool-Using Language-Model Agents
DOI:
https://doi.org/10.68854/95fpkq71Keywords:
agentic AI, large language model agents, tool use, function calling, levels of autonomy, delegation, accountability, prompt injection, human oversight, bounded autonomyAbstract
The term agentic AI is now applied to systems that range from a chatbot permitted to call a calculator to a persistent, self-directing orchestrator that spawns sub-agents, browses the open web and executes irreversible actions in production environments. Treating these as a single category obscures the fact that each step along that range introduces a distinct failure mode and a distinct accountability question. This paper proposes a taxonomy that makes the steps explicit. Drawing on the recent survey literature on language-model agents, on empirical work on tool-use and function-calling reliability, on the security literature on prompt injection in tool-integrated systems, and on the philosophical and legal literature on delegation, responsibility gaps and meaningful human control, it defines six levels of autonomy for tool-using language-model agents (responder, tool-calling assistant, bounded executor, goal-directed agent, orchestrating agent and persistent autonomous agent) and three cross-cutting dimensions along which any agent at any level can be positioned: the action surface it can reach, the environment it is exposed to, and the oversight regime under which it runs. For each level the paper identifies the characteristic failure modes and the accountability instruments that remain feasible. Its central argument is that accountability does not diminish as autonomy rises, as the delegation framing implies, but must be deliberately scaled up with it, and that most current deployments invert this relationship by expanding autonomy faster than they expand the instruments by which a human can answer for what the agent does. The paper closes with seven design principles for bounded autonomy, a note on deployment under infrastructure constraints, and a research agenda.
References
Abou Ali, M., Dornaika, F., & Charafeddine, J. (2025). Agentic AI: A comprehensive survey of architectures, applications, and future directions. Artificial Intelligence Review, 59(1), 11. https://doi.org/10.1007/s10462-025-11422-4
Chen, J., Wu, H., Pang, J., Wang, Y., Zhang, D., & Sun, C. (2025). Tool learning with language models: A comprehensive survey of methods, pipelines, and benchmarks. Vicinagearth, 2(1), 16. https://doi.org/10.1007/s44336-025-00024-x
Cheung, K. T., & Ramamoorti, S. (2026). Accountability in smart contracts and agentic AI: How to address the responsibility gap and retain meaningful human control? AI and Ethics, 6(6), 585. https://doi.org/10.1007/s43681-026-01434-3
Darvishi, A., Khosravi, H., Sadiq, S., Gašević, D., & Siemens, G. (2024). Impact of AI assistance on student agency. Computers & Education, 210, 104967. https://doi.org/10.1016/j.compedu.2023.104967
Farahani, M. A., Khan, M. I., & Wuest, T. (2026). Hybrid agentic AI and multi-agent systems in smart manufacturing. Journal of Manufacturing Systems, 86, 612–623. https://doi.org/10.1016/j.jmsy.2026.04.002
Gabauer, C. (2026). LLM-based agent systems: A systematic literature review and position on hybrid architectures and evaluation frameworks. Applied Intelligence, 56(10), 325. https://doi.org/10.1007/s10489-026-07340-9
Gohil, V., Shah, S. B., Rauniyar, K., Shiwakoti, S., Thapa, S., Sheng, D., Thapa, L., Johnson, K. T., & Naseem, U. (2026). Towards safe and trustworthy agentic AI: Foundations, taxonomy, technologies, applications, and future directions. Artificial Intelligence Review. Advance online publication. https://doi.org/10.1007/s10462-026-11682-8
Heersmink, R., de Rooij, B., Clavel Vázquez, M. J., & Colombo, M. (2024). A phenomenology and epistemology of large language models: Transparency, trust, and trustworthiness. Ethics and Information Technology, 26(3), 41. https://doi.org/10.1007/s10676-024-09777-3
Hicks, M. T., Humphries, J., & Slater, J. (2024). ChatGPT is bullshit. Ethics and Information Technology, 26(2), 38. https://doi.org/10.1007/s10676-024-09775-5
Kalluri, R. (2026). The responsibility cascade: Moral attribution and governance challenges in agentic AI systems. Digital Society, 5(3), 47. https://doi.org/10.1007/s44206-026-00288-w
Khan, A., AlKhanbashi, K., & Mohamed, A. (2026). Evaluating indirect prompt injection defenses in tool-using LLM agents: Security, utility, and replication. Computers, 15(9), 570. https://doi.org/10.3390/computers15090570
Kong, K. C. Y. (2026). The delegation illusion: Why deploying autonomous AI agents does not diminish principal responsibility. AI and Ethics, 6(5), 518. https://doi.org/10.1007/s43681-026-01383-x
Kumar, M., & Singh, D. (2026). Balancing autonomy and oversight in reliable agentic artificial intelligence through adaptive human interaction architectures. Discover Artificial Intelligence, 6(1), 709. https://doi.org/10.1007/s44163-026-01373-2
Moralles, C., Costa, L. A. L. F. da, Rigo, S. J., Kunst, R., Souza, V. C. de, Silva, É. P., Prado, G. L. E., Schardosim, T. de C., & Roehrs, A. (2026). A systematic literature review of agentic AI: Definitions, architectures, and challenges. IEEE Access, 14, 36176–36190. https://doi.org/10.1109/access.2026.3668138
Mourad, S., Abdallah, E. E., & Ababneh, M. (2026). Securing the prompt pipeline: A systematic review of defense mechanisms against prompt-based attacks in LLM agents. Electronics, 15(16), 3700. https://doi.org/10.3390/electronics15163700
Paseri, L., & Durante, M. (2025). Examining epistemological challenges of large language models in law. Cambridge Forum on AI: Law and Governance, 1, e7. https://doi.org/10.1017/cfl.2024.7
Revesai, Z., & Chipfumbu, C. T. (2026). Data protection in the era of large language models: Challenges and opportunities. AI and Ethics, 6(4), 356. https://doi.org/10.1007/s43681-026-01223-y
Salah, M., Al-Busaidi, R., Al-Ghawi, A., & Shawky, W. (2026). The regulation paradox: Agentic AI, bounded autonomy, and self-regulated learning in higher education. Frontiers in Education, 11, 1902833. https://doi.org/10.3389/feduc.2026.1902833
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., Zhao, W. X., Wei, Z., & Wen, J. (2024). A survey on large language model based autonomous agents. Frontiers of Computer Science, 18(6), 186345. https://doi.org/10.1007/s11704-024-40231-1
Wang, M., Zhang, Y., Yu, B., Hao, B., Peng, C., Chen, Y., Zhou, W., Gu, J., Zhuang, C., Guo, R., Wang, W., & Zhao, X. (2026). Function calling in large language models: Industrial practices, challenges, and future directions. ACM Computing Surveys, 58(9), 1–37. https://doi.org/10.1145/3788284
Woesle, C., & Buettner, R. (2026). A systematic literature review of prompt injection attacks in LLM-integrated systems. IEEE Access, 14, 86797–86818. https://doi.org/10.1109/access.2026.3700492
Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, E., Zheng, R., Fan, X., Wang, X., Xiong, L., Zhou, Y., Wang, W., Jiang, C., Zou, Y., Liu, X., … Gui, T. (2025). The rise and potential of large language model based agents: A survey. Science China Information Sciences, 68(2), 121101. https://doi.org/10.1007/s11432-024-4222-0
Downloads
Published
Issue
Section
License
Copyright (c) 2026 IIAR Journal of Governance and Public Administration

This work is licensed under a Creative Commons Attribution 4.0 International License.