Distributed artificial intelligence

Short description: Subfield of artificial intelligence

Distributed Artificial Intelligence (DAI) (also called Decentralized Artificial Intelligence) is a melding of artificial intelligence with distributed computing. From artificial intelligence comes the theory and technology for constructing or analyzing an intelligent system. But where artificial intelligence uses psychology as a source of ideas, inspiration, and metaphor, DAI uses sociology, economics, and management science for inspiration. Where the focus of artificial intelligence is on the individual, the focus of DAI is on the group. Distributed computing provides the computational substrate on which this group focus can occur. Using techniques from artificial intelligence, communication theory, control theory, and interaction theory, it produces a cooperative solution to problems by a decentralized group of computational entities (agents).

DAI is closely related to and a predecessor of the field of multi-agent systems. They are distinguished generally by multi-agent systems being open, where the entities might arise from different interests and have individual goals, and distributed artificial-intelligence systems, where the entities have common goals. There are numerous applications and tools.

Definition

Distributed Artificial Intelligence (DAI) is an approach to solving complex learning, planning, and decision-making problems. It is embarrassingly parallel, thus able to exploit large scale computation and spatial distribution of computing resources. These properties allow it to solve problems that require the processing of very large data sets. DAI systems consist of autonomous learning processing nodes (agents), that are distributed, often at a very large scale. DAI nodes can act independently, and partial solutions are integrated by communication between nodes, often asynchronously. By virtue of their scale, DAI systems are robust and elastic, and by necessity, loosely coupled. Furthermore, DAI systems are built to be adaptive to changes in the problem definition or underlying data sets due to the scale and difficulty in redeployment.

DAI systems do not require all the relevant data to be aggregated in a single location, in contrast to monolithic or centralized Artificial Intelligence systems, which have tightly coupled and geographically close processing nodes. Therefore, DAI systems often operate on sub-samples or hashed impressions of very large datasets. In addition, the source dataset may change or be updated during the course of the execution of a DAI system.

Development

In 1975 distributed artificial intelligence emerged as a subfield of artificial intelligence that dealt with interactions of intelligent agents. As a scientific discipline, it progressed through a series of workshops in the USA (International Workshop on Distributed Artificial Intelligence, held in 13 editions from 1978 - 1994), Europe (Workshop on Modelling Autonomous Agents in a Multi-Agent World https://link.springer.com/conference/maamaw), and Asia (Multi-Agent and Cooperative Computation Workshop (MACC) https://sites.google.com/view/sig-macc/macc-workshop?authuser=0). Distributed artificial intelligence systems were conceived as a group of intelligent entities, called agents, that interacted by cooperation, by coexistence, or by competition. DAI is categorized into multi-agent systems and distributed problem solving. In multi-agent systems the main focus is how agents coordinate their knowledge and activities. For distributed problem solving the major focus is how the problem is decomposed and the solutions are synthesized.

Goals

The objectives of Distributed Artificial Intelligence are to solve the reasoning, planning, learning and perception problems of artificial intelligence, especially if they require large data, by distributing the problem to autonomous processing nodes (agents). To reach the objective, DAI requires:

• A distributed system with robust and elastic computation on unreliable and failing resources that are loosely coupled
• Coordination of the actions and communication of the nodes
• Subsamples of large data sets and online machine learning

There are many reasons for wanting to distribute intelligence or cope with multi-agent systems. Mainstream problems in DAI research include the following:

• Parallel problem solving: mainly deals with how classic artificial intelligence concepts can be modified, so that multiprocessor systems and clusters of computers can be used to speed up calculation.
• Distributed problem solving (DPS): the concept of agent, autonomous entities that can communicate with each other, was developed to serve as an abstraction for developing DPS systems. See below for further details.
• Multi-Agent Based Simulation (MABS): a branch of DAI that builds the foundation for simulations that need to analyze not only phenomena at macro level but also at micro level, as it is in many social simulation scenarios.

Approaches

Two types of DAI has emerged:

• In Multi-agent systems agents coordinate their knowledge and activities and reason about the processes of coordination. Agents are physical or virtual entities that can act, perceive their environment, and communicate with other agents. An agent is autonomous and has skills to achieve goals. The agents change the state of their environment by their actions. There are a number of different coordination techniques.
• In distributed problem solving the work is divided among nodes and the knowledge is shared. The main concerns are task decomposition and synthesis of the knowledge and solutions.

DAI can apply a bottom-up approach to AI, similar to the subsumption architecture as well as the traditional top-down approach of AI. In addition, DAI can also be a vehicle for emergence.

Challenges

The challenges in Distributed AI are:

1. How to carry out communication and interaction of agents and which communication language or protocols should be used.
2. How to ensure the coherency of agents.
3. How to synthesise the results among 'intelligent agents' group by formulation, description, decomposition and allocation.

Applications and tools

Areas where DAI have been applied are:

• Electronic commerce, e.g. for trading strategies the DAI system learns financial trading rules from subsamples of very large samples of financial data
• Networks, e.g. in telecommunications the DAI system controls the cooperative resources in a WLAN network
• Routing, e.g. model vehicle flow in transport networks
• Scheduling, e.g. flow shop scheduling where the resource management entity ensures local optimization and cooperation for global and local consistency
• Search engines, e.g. in LLM federated search like Ithy where document retrieval and analysis are distributed to DAI agents before aggregation
• Multi-Agent systems, e.g. artificial life, the study of simulated life
• Electric power systems, e.g. Condition Monitoring Multi-Agent System (COMMAS) applied to transformer condition monitoring, and IntelliTEAM II Automatic Restoration System

DAI integration in tools has included:

• ECStar is a distributed rule-based learning system.

Agents

Systems: Agents and multi-agents

Notion of Agents: Agents can be described as distinct entities with standard boundaries and interfaces designed for problem solving.

Notion of Multi-Agents: Multi-Agent system is defined as a network of agents which are loosely coupled working as a single entity like society for problem solving that an individual agent cannot solve.

Software agents

The key concept used in DPS and MABS is the abstraction called software agents. An agent is a virtual (or physical) autonomous entity that has an understanding of its environment and acts upon it. An agent is usually able to communicate with other agents in the same system to achieve a common goal, that one agent alone could not achieve. This communication system uses an agent communication language.

A first classification that is useful is to divide agents into:

• reactive agent – A reactive agent is not much more than an automaton that receives input, processes it and produces an output.
• deliberative agent – A deliberative agent in contrast should have an internal view of its environment and is able to follow its own plans.
• hybrid agent – A hybrid agent is a mixture of reactive and deliberative, that follows its own plans, but also sometimes directly reacts to external events without deliberation.

Well-recognized agent architectures that describe how an agent is internally structured are:

• ASMO (emergence of distributed modules)
• BDI (Believe Desire Intention, a general architecture that describes how plans are made)
• InterRAP (A three-layer architecture, with a reactive, a deliberative and a social layer)
• PECS (Physics, Emotion, Cognition, Social, describes how those four parts influences the agents behavior).
• Soar (a rule-based approach)

See also

• Collective intelligence
• Federated learning – Decentralized machine learning
• Simulated reality
• Swarm Intelligence

Further reading

• Hewitt, Carl; and Jeff Inman (November/December 1991). "DAI Betwixt and Between: From 'Intelligent Agents' to Open Systems Science" IEEE Transactions on Systems, Man, and Cybernetics. Volume: 21 Issue: 6, pps. 1409–1419. ISSN 0018-9472
• Grace, David; Zhang, Honggang (August 2012). Cognitive Communications: Distributed Artificial Intelligence (DAI), Regulatory Policy and Economics, Implementation. John Wiley & Sons Press. ISBN 978-1-119-95150-6
• Shoham, Yoav; Leyton-Brown, Kevin (2009). Multiagent Systems: Algorithmic, Game-Theoretic, and Logical Foundations. New York: Cambridge University Press. ISBN 978-0-521-89943-7. http://www.masfoundations.org/download.html. 
• Sun, Ron, (2005). Cognition and Multi-Agent Interaction. New York: Cambridge University Press. ISBN 978-0-521-83964-8
• Trentesaux, Damien; Philippe, Pesin; Tahon, Christian (2000). "Distributed artificial intelligence for FMS scheduling, control and design support". Journal of Intelligent Manufacturing 11 (6): 573–589. doi:10.1023/A:1026556507109. 
• Vlassis, Nikos (2007). A Concise Introduction to Multiagent Systems and Distributed Artificial Intelligence. San Rafael, CA: Morgan & Claypool Publishers. ISBN 978-1-59829-526-9.