Multi-agent system
Part of a series on |
Multi-agent systems |
---|
Multi-agent simulation |
|
Agent-oriented programming |
Related |
A multi-agent system (MAS or "self-organized system") is a computerized system composed of multiple interacting
Despite considerable overlap, a multi-agent system is not always the same as an agent-based model (ABM). The goal of an ABM is to search for explanatory insight into the collective behavior of agents (which do not necessarily need to be "intelligent") obeying simple rules, typically in natural systems, rather than in solving specific practical or engineering problems. The terminology of ABM tends to be used more often in the science, and MAS in engineering and technology.[4] Applications where multi-agent systems research may deliver an appropriate approach include online trading,[5] disaster response,[6][7] target surveillance[8] and social structure modelling.[9]
Concept
Multi-agent systems consist of agents and their
Agents can be divided into types spanning simple to complex. Categories include:
- Passive agents[10] or "agent without goals" (such as obstacle, apple or key in any simple simulation)
- Active agentsprey-predator model)
- Cognitive agents (complex calculations)
Agent environments can be divided into:
- Virtual
- Discrete
- Continuous
Agent environments can also be organized according to properties such as accessibility (whether it is possible to gather complete information about the environment), determinism (whether an action causes a definite effect), dynamics (how many entities influence the environment in the moment), discreteness (whether the number of possible actions in the environment is finite), episodicity (whether agent actions in certain time periods influence other periods),[11] and dimensionality (whether spatial characteristics are important factors of the environment and the agent considers space in its decision making).[12] Agent actions are typically mediated via an appropriate middleware. This middleware offers a first-class design abstraction for multi-agent systems, providing means to govern resource access and agent coordination.[13]
Characteristics
The agents in a multi-agent system have several important characteristics:[14]
- Autonomy: agents at least partially independent, self-aware, autonomous
- Local views: no agent has a full global view, or the system is too complex for an agent to exploit such knowledge
- Decentralization: no agent is designated as controlling (or the system is effectively reduced to a monolithic system)[15]
Self-organisation and self-direction
Multi-agent systems can manifest
System paradigms
Many MAS are implemented in computer simulations, stepping the system through discrete "time steps". The MAS components communicate typically using a weighted request matrix, e.g.
Speed-VERY_IMPORTANT: min=45 mph, Path length-MEDIUM_IMPORTANCE: max=60 expectedMax=40, Max-Weight-UNIMPORTANT Contract Priority-REGULAR
and a weighted response matrix, e.g.
Speed-min:50 but only if weather sunny, Path length:25 for sunny / 46 for rainy Contract Priority-REGULAR note – ambulance will override this priority and you'll have to wait
A challenge-response-contract scheme is common in MAS systems, where
- First a "Who can?" question is distributed.
- Only the relevant components respond: "I can, at this price".
- Finally, a contract is set up, usually in several short communication steps between sides,
also considering other components, evolving "contracts" and the restriction sets of the component algorithms.
Another paradigm commonly used with MAS is the "pheromone", where components leave information for other nearby components. These pheromones may evaporate/concentrate with time, that is their values may decrease (or increase).
Properties
MAS tend to find the best solution for their problems without intervention. There is high similarity here to physical phenomena, such as energy minimizing, where physical objects tend to reach the lowest energy possible within the physically constrained world. For example: many of the cars entering a metropolis in the morning will be available for leaving that same metropolis in the evening.
The systems also tend to prevent propagation of faults, self-recover and be fault tolerant, mainly due to the redundancy of components.
Research
The study of multi-agent systems is "concerned with the development and analysis of sophisticated AI problem-solving and control architectures for both single-agent and multiple-agent systems."[16] Research topics include:
- agent-oriented software engineering
- beliefs, desires, and intentions (BDI)
- cooperation and coordination
- distributed constraint optimization (DCOPs)
- organization
- communication
- negotiation
- distributed problem solving
- multi-agent learning[17]
- agent mining
- scientific communities (e.g., on biological flocking, language evolution, and economics)[18][19]
- dependability and fault-tolerance
- robotics,[20] multi-robot systems (MRS), robotic clusters
- multi-agent systems also present possible applications in microrobotics,[21] where the physical interaction between the agents are exploited to perform complex tasks such as manipulation and assembly of passive components.[22]
Frameworks
Frameworks have emerged that implement common standards (such as the FIPA and OMG MASIF standards).[23] These frameworks e.g. JADE, save time and aid in the standardization of MAS development.[24]
Currently though, no standard is actively maintained from FIPA or OMG. Efforts for further development of software agents in industrial context are carried out in IEEE IES technical committee on Industrial Agents.[25]
Applications
MAS have not only been applied in academic research, but also in industry.[26] MAS are applied in the real world to graphical applications such as computer games. Agent systems have been used in films.[27] It is widely advocated for use in networking and mobile technologies, to achieve automatic and dynamic load balancing, high scalability and self-healing networks. They are being used for coordinated defence systems.
Other applications.
Also, Multi-agent Systems Artificial Intelligence (MAAI) are used for simulating societies, the purpose thereof being helpful in the fields of climate, energy, epidemiology, conflict management, child abuse, ....[33] Some organisations working on using multi-agent system models include Center for Modelling Social Systems, Centre for Research in Social Simulation, Centre for Policy Modelling, Society for Modelling and Simulation International.[33]
Vehicular traffic with controlled autonomous vehicles can be modelling as a multi-agent system involving crowd dynamics.[34] Hallerbach et al. discussed the application of agent-based approaches for the development and validation of automated driving systems via a digital twin of the vehicle-under-test and microscopic traffic simulation based on independent agents.[35] Waymo has created a multi-agent simulation environment Carcraft to test algorithms for self-driving cars.[36][37] It simulates traffic interactions between human drivers, pedestrians and automated vehicles. People's behavior is imitated by artificial agents based on data of real human behavior.
See also
- Comparison of agent-based modeling software
- Agent-based computational economics (ACE)
- Artificial brain
- Artificial intelligence
- Artificial life
- Artificial philosophy
- AI mayor
- Black box
- Blackboard system
- Complex systems
- Discrete event simulation
- Distributed artificial intelligence
- Emergence
- Evolutionary computation
- Friendly artificial intelligence
- Game theory
- Hallucination (artificial intelligence)
- Human-based genetic algorithm
- Hybrid intelligent system
- Knowledge Query and Manipulation Language (KQML)
- Microbial intelligence
- Multi-agent planning
- Multi-agent reinforcement learning
- Pattern-oriented modeling
- PlatBox Project
- Reinforcement learning
- Scientific community metaphor
- Self-reconfiguring modular robot
- Simulated reality
- Social simulation
- Software agent
- Software bot
- Swarm intelligence
- Swarm robotics
References
- ^ Yoav Shoham, Kevin Leyton-Brown. Multiagent Systems: Algorithmic, Game-Theoretic, and Logical Foundations. Cambridge University Press, 2009. http://www.masfoundations.org/
- ^ Hu, J.; Turgut, A.; Lennox, B.; Arvin, F., "Robust Formation Coordination of Robot Swarms with Nonlinear Dynamics and Unknown Disturbances: Design and Experiments" IEEE Transactions on Circuits and Systems II: Express Briefs, 2021.
- ^ Stefano V. Albrecht, Filippos Christianos, Lukas Schäfer. Multi-Agent Reinforcement Learning: Foundations and Modern Approaches. MIT Press, 2024. https://www.marl-book.com/
- S2CID 17934527.
- S2CID 207163424. Archived from the originalon April 2, 2010. Retrieved March 18, 2008.
- ^ Schurr, Nathan; Marecki, Janusz; Tambe, Milind; Scerri, Paul; Kasinadhuni, Nikhil; Lewis, J.P. (2005). "The Future of Disaster Response: Humans Working with Multiagent Teams using DEFACTO". Archived (PDF) from the original on June 3, 2013. Retrieved January 8, 2024.
- ISBN 978-3-642-33217-3.
- S2CID 149609966.
- ^ Sun, Ron; Naveh, Isaac (June 30, 2004). "Simulating Organizational Decision-Making Using a Cognitively Realistic Agent Model". Journal of Artificial Societies and Social Simulation.
- ^ a b Kubera, Yoann; Mathieu, Philippe; Picault, Sébastien (2010), "Everything can be Agent!" (PDF), Proceedings of the Ninth International Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS'2010): 1547–1548
- ISBN 0-13-790395-2
- ISBN 978-80-904661-1-1.
- S2CID 13347050.
- ISBN 978-0-471-49691-5.
- S2CID 19706.
- ^ "The Multi-Agent Systems Lab". University of Massachusetts Amherst. Retrieved October 16, 2009.
- ^ Albrecht, Stefano; Stone, Peter (2017), "Multiagent Learning: Foundations and Recent Trends. Tutorial", IJCAI-17 conference (PDF)
- S2CID 2637067. Retrieved June 9, 2008.
- S2CID 14655317. Retrieved June 9, 2008.
- S2CID 2734931
- S2CID 228892228.
- S2CID 262167298.
- ^ "OMG Document – orbos/97-10-05 (Update of Revised MAF Submission)". www.omg.org. Retrieved February 19, 2019.
- ^ Ahmed, Salman; Karsiti, Mohd N.; Agustiawan, Herman (2007). "A development framework for collaborative robots using feedback control". ResearchGate. Retrieved January 8, 2024.
- ^ "IEEE IES Technical Committee on Industrial Agents (TC-IA)". tcia.ieee-ies.org. Retrieved February 19, 2019.
- )
- MASSIVE. Retrieved April 28, 2012.
- S2CID 579475.
- ^ Xiao-Feng Xie, S. Smith, G. Barlow. Schedule-driven coordination for real-time traffic network control. International Conference on Automated Planning and Scheduling (ICAPS), São Paulo, Brazil, 2012: 323–331.
- .
- . Retrieved January 8, 2024.
- . Retrieved January 8, 2024.
- ^ a b "AI can predict your future behaviour with powerful new simulations". New Scientist.
- ISSN 2573-5144.
- .
- ^ Madrigal, Story by Alexis C. "Inside Waymo's Secret World for Training Self-Driving Cars". The Atlantic. Retrieved August 14, 2020.
- ^ Connors, J.; Graham, S.; Mailloux, L. (2018). "Cyber Synthetic Modeling for Vehicle-to-Vehicle Applications". In International Conference on Cyber Warfare and Security. Academic Conferences International Limited: 594-XI.
Further reading
- Wooldridge, Michael (2002). An Introduction to MultiAgent Systems. ISBN 978-0-471-49691-5.
- Shoham, Yoav; Leyton-Brown, Kevin (2008). Multiagent Systems: Algorithmic, Game-Theoretic, and Logical Foundations. ISBN 978-0-521-89943-7.
- Mamadou, Tadiou Koné; Shimazu, A.; Nakajima, T. (August 2000). "The State of the Art in Agent Communication Languages (ACL)". Knowledge and Information Systems. 2 (2): 1–26.
- Hewitt, Carl; Inman, Jeff (November–December 1991). "DAI Betwixt and Between: From "Intelligent Agents" to Open Systems Science" (PDF). IEEE Transactions on Systems, Man, and Cybernetics. 21 (6): 1409–1419. S2CID 39080989. Archived from the original(PDF) on August 31, 2017.
- The Journal of Autonomous Agents and Multi-Agent Systems (JAAMAS)
- Weiss, Gerhard, ed. (1999). Multiagent Systems, A Modern Approach to Distributed Artificial Intelligence. MIT Press. ISBN 978-0-262-23203-6.
- Ferber, Jacques (1999). Multi-Agent Systems: An Introduction to Artificial Intelligence. Addison-Wesley. ISBN 978-0-201-36048-6.
- Weyns, Danny (2010). Architecture-Based Design of Multi-Agent Systems. Springer. ISBN 978-3-642-01063-7.
- ISBN 978-0-521-83964-8.
- Keil, David; Goldin, Dina (2006). Weyns, Danny; Parunak, Van; Michel, Fabien (eds.). Indirect Interaction in Environments for Multiagent Systems. LNCS 3830. Vol. 3830. )
- Whitestein Series in Software Agent Technologies and Autonomic Computing, published by Springer Science+Business Media Group
- Salamon, Tomas (2011). Design of Agent-Based Models : Developing Computer Simulations for a Better Understanding of Social Processes. Bruckner Publishing. ISBN 978-80-904661-1-1.
- ISBN 0-13-790395-2
- Fasli, Maria (2007). Agent-technology for E-commerce. ISBN 978-0-470-03030-1.
- Cao, Longbing, Gorodetsky, Vladimir, Mitkas, Pericles A. (2009). Agent Mining: The Synergy of Agents and Data Mining, IEEE Intelligent Systems, vol. 24, no. 3, 64-72.