Agentic AI Systems: A Taxonomy of Autonomy, Delegation and Accountability for Tool-Using Language-Model Agents

Authors

  • Atolagbe Umar Kawu Veristzon Global Research Lab Author
  • NWOGBOJI Emmanuel Usulor Veristzon Global Research Lab Author

DOI:

https://doi.org/10.68854/95fpkq71

Keywords:

agentic AI, large language model agents, tool use, function calling, levels of autonomy, delegation, accountability, prompt injection, human oversight, bounded autonomy

Abstract

The term agentic AI is now applied to systems that range from a chatbot permitted to call a calculator to a persistent, self-directing orchestrator that spawns sub-agents, browses the open web and executes irreversible actions in production environments. Treating these as a single category obscures the fact that each step along that range introduces a distinct failure mode and a distinct accountability question. This paper proposes a taxonomy that makes the steps explicit. Drawing on the recent survey literature on language-model agents, on empirical work on tool-use and function-calling reliability, on the security literature on prompt injection in tool-integrated systems, and on the philosophical and legal literature on delegation, responsibility gaps and meaningful human control, it defines six levels of autonomy for tool-using language-model agents (responder, tool-calling assistant, bounded executor, goal-directed agent, orchestrating agent and persistent autonomous agent) and three cross-cutting dimensions along which any agent at any level can be positioned: the action surface it can reach, the environment it is exposed to, and the oversight regime under which it runs. For each level the paper identifies the characteristic failure modes and the accountability instruments that remain feasible. Its central argument is that accountability does not diminish as autonomy rises, as the delegation framing implies, but must be deliberately scaled up with it, and that most current deployments invert this relationship by expanding autonomy faster than they expand the instruments by which a human can answer for what the agent does. The paper closes with seven design principles for bounded autonomy, a note on deployment under infrastructure constraints, and a research agenda.

References

Abou Ali, M., Dornaika, F., & Charafeddine, J. (2025). Agentic AI: A comprehensive survey of architectures, applications, and future directions. Artificial Intelligence Review, 59(1), 11. https://doi.org/10.1007/s10462-025-11422-4

Chen, J., Wu, H., Pang, J., Wang, Y., Zhang, D., & Sun, C. (2025). Tool learning with language models: A comprehensive survey of methods, pipelines, and benchmarks. Vicinagearth, 2(1), 16. https://doi.org/10.1007/s44336-025-00024-x

Cheung, K. T., & Ramamoorti, S. (2026). Accountability in smart contracts and agentic AI: How to address the responsibility gap and retain meaningful human control? AI and Ethics, 6(6), 585. https://doi.org/10.1007/s43681-026-01434-3

Darvishi, A., Khosravi, H., Sadiq, S., Gašević, D., & Siemens, G. (2024). Impact of AI assistance on student agency. Computers & Education, 210, 104967. https://doi.org/10.1016/j.compedu.2023.104967

Farahani, M. A., Khan, M. I., & Wuest, T. (2026). Hybrid agentic AI and multi-agent systems in smart manufacturing. Journal of Manufacturing Systems, 86, 612–623. https://doi.org/10.1016/j.jmsy.2026.04.002

Gabauer, C. (2026). LLM-based agent systems: A systematic literature review and position on hybrid architectures and evaluation frameworks. Applied Intelligence, 56(10), 325. https://doi.org/10.1007/s10489-026-07340-9

Gohil, V., Shah, S. B., Rauniyar, K., Shiwakoti, S., Thapa, S., Sheng, D., Thapa, L., Johnson, K. T., & Naseem, U. (2026). Towards safe and trustworthy agentic AI: Foundations, taxonomy, technologies, applications, and future directions. Artificial Intelligence Review. Advance online publication. https://doi.org/10.1007/s10462-026-11682-8

Heersmink, R., de Rooij, B., Clavel Vázquez, M. J., & Colombo, M. (2024). A phenomenology and epistemology of large language models: Transparency, trust, and trustworthiness. Ethics and Information Technology, 26(3), 41. https://doi.org/10.1007/s10676-024-09777-3

Hicks, M. T., Humphries, J., & Slater, J. (2024). ChatGPT is bullshit. Ethics and Information Technology, 26(2), 38. https://doi.org/10.1007/s10676-024-09775-5

Kalluri, R. (2026). The responsibility cascade: Moral attribution and governance challenges in agentic AI systems. Digital Society, 5(3), 47. https://doi.org/10.1007/s44206-026-00288-w

Khan, A., AlKhanbashi, K., & Mohamed, A. (2026). Evaluating indirect prompt injection defenses in tool-using LLM agents: Security, utility, and replication. Computers, 15(9), 570. https://doi.org/10.3390/computers15090570

Kong, K. C. Y. (2026). The delegation illusion: Why deploying autonomous AI agents does not diminish principal responsibility. AI and Ethics, 6(5), 518. https://doi.org/10.1007/s43681-026-01383-x

Kumar, M., & Singh, D. (2026). Balancing autonomy and oversight in reliable agentic artificial intelligence through adaptive human interaction architectures. Discover Artificial Intelligence, 6(1), 709. https://doi.org/10.1007/s44163-026-01373-2

Moralles, C., Costa, L. A. L. F. da, Rigo, S. J., Kunst, R., Souza, V. C. de, Silva, É. P., Prado, G. L. E., Schardosim, T. de C., & Roehrs, A. (2026). A systematic literature review of agentic AI: Definitions, architectures, and challenges. IEEE Access, 14, 36176–36190. https://doi.org/10.1109/access.2026.3668138

Mourad, S., Abdallah, E. E., & Ababneh, M. (2026). Securing the prompt pipeline: A systematic review of defense mechanisms against prompt-based attacks in LLM agents. Electronics, 15(16), 3700. https://doi.org/10.3390/electronics15163700

Paseri, L., & Durante, M. (2025). Examining epistemological challenges of large language models in law. Cambridge Forum on AI: Law and Governance, 1, e7. https://doi.org/10.1017/cfl.2024.7

Revesai, Z., & Chipfumbu, C. T. (2026). Data protection in the era of large language models: Challenges and opportunities. AI and Ethics, 6(4), 356. https://doi.org/10.1007/s43681-026-01223-y

Salah, M., Al-Busaidi, R., Al-Ghawi, A., & Shawky, W. (2026). The regulation paradox: Agentic AI, bounded autonomy, and self-regulated learning in higher education. Frontiers in Education, 11, 1902833. https://doi.org/10.3389/feduc.2026.1902833

Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., Zhao, W. X., Wei, Z., & Wen, J. (2024). A survey on large language model based autonomous agents. Frontiers of Computer Science, 18(6), 186345. https://doi.org/10.1007/s11704-024-40231-1

Wang, M., Zhang, Y., Yu, B., Hao, B., Peng, C., Chen, Y., Zhou, W., Gu, J., Zhuang, C., Guo, R., Wang, W., & Zhao, X. (2026). Function calling in large language models: Industrial practices, challenges, and future directions. ACM Computing Surveys, 58(9), 1–37. https://doi.org/10.1145/3788284

Woesle, C., & Buettner, R. (2026). A systematic literature review of prompt injection attacks in LLM-integrated systems. IEEE Access, 14, 86797–86818. https://doi.org/10.1109/access.2026.3700492

Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, E., Zheng, R., Fan, X., Wang, X., Xiong, L., Zhou, Y., Wang, W., Jiang, C., Zou, Y., Liu, X., … Gui, T. (2025). The rise and potential of large language model based agents: A survey. Science China Information Sciences, 68(2), 121101. https://doi.org/10.1007/s11432-024-4222-0

Published

2026-10-27