Hybrid Intelligence

In plain words

This is a short essay that proposes a name and a way of thinking for a common situation: people and computers each do some things well and some things badly. People are good at common sense, flexible judgement and dealing with messy, unlabelled situations. Computers are good at spotting patterns in large amounts of data, staying consistent and working quickly.

The authors call the combined arrangement Hybrid Intelligence. The idea is to split a complex job between a person and an AI so that together they do better than either could alone, and to let them improve each other over time. The paper describes two directions this can take: the AI helps a person make better decisions, or the person teaches the AI, for example by labelling data or checking its work.

The paper does not build or test a system. It argues that this arrangement is likely to be the main pattern for dividing work between humans and machines in coming decades, and it lists open questions about trust, rules for running such systems, and how people will work with them.

TL;DR

A position paper, published in Business & Information Systems Engineering in 2019 p. 637, that defines Hybrid Intelligence as humans and AI combining complementary strengths to reach results neither could reach alone, and improving through mutual learning §4 p. 640. It contrasts human intuition with machine analysis fig. 1 and describes AI in the loop of human intelligence and human intelligence in the loop of AI §3.1 §3.2. It proposes three research directions: trust, governance and digital work §6. Nothing is implemented, measured or evaluated, so the central claim of superior outcomes is untested. Relevant to an engineer as a vocabulary and a list of design questions, not as a method.

Problem

The authors observe that AI solves clearly defined tasks, such as chess, Go or object identification, but that general AI is doubted to be near and that AI is rarely applied to complex business problems in organisations §1 p. 637. They argue that the most likely division of labour between humans and machines in the coming decades is a combination of both, rather than replacement §1 p. 637. They do not measure how often this happens or what it costs.

Method

This is a conceptual paper, not a method. There are no equations, algorithms, training procedures or experiments. The steps below restate the paper's framework. Section numbers are the paper's own; p. N refers to the printed page numbers 637–643 of the journal version (the arXiv PDF adds one cover page before them).

The paper has no algorithm. The sketch below only shows how its framework fits together; it is not an implementation, and the paper does not say how any of its functions would work.

# Hybrid Intelligence round, as the paper frames it  [§4] [fig. 2]
# Conceptual sketch: the paper gives no algorithm and no interfaces.
# Input:  a task; a human agent; an AI agent
# Output: a result; the updated human and AI agents

def hybrid_round(task, human, ai):
    # Allocate each part to the agent suited to it  [§4] [fig. 1]
    # The paper does not say how this allocation is made.
    human_part, ai_part = allocate(task, human, ai)

    # Human side: intuition, common sense, unlabelled cases  [§3] [fig. 1]
    human_output = human.decide(human_part)

    # AI side: pattern recognition, consistency, speed  [§3] [fig. 1]
    ai_output = ai.predict(ai_part)

    # Combine the two outputs; the paper does not specify how  [§4]
    result = combine(human_output, ai_output)

    # Learning goes both ways: the AI learns from human judgement  [§3.2]
    # and the human learns from the AI's outputs  [§3.1] [§5]
    human, ai = exchange_feedback(human, ai, result)

    return result, human, ai

1. Definitions of intelligence §2.1–§2.4 p. 637–638. The paper uses a general definition: the ability to accomplish complex goals, learn, reason and adaptively perform effective actions in an environment §2.1 p. 638. It distinguishes human intelligence, collective intelligence (large groups of similar agents acting together) and artificial intelligence §2.2–§2.4. Hybrid Intelligence is set apart from collective intelligence because it combines heterogeneous agents, humans and machines, rather than many similar ones §2.3 p. 638.

2. Complementary strengths §3 fig. 1 p. 639–640. Fig. 1 lists human strengths as flexibility and transfer, empathy and creativity, annotating arbitrary data, and common sense, grouped as intuitive. It lists machine strengths as pattern recognition, probabilistic reasoning, consistency, and speed and efficiency, grouped as analytic fig. 1 p. 640. The text cites a dual-process account in which humans use fast intuitive thinking and slow rule-based thinking, while machines are strong at rule- based processing §3 p. 639. It also cites evidence that simple statistical models outperform human experts on predictions under uncertainty §3 p. 639.

3. AI in the loop of human intelligence §3.1 p. 639. AI automates tasks that machines can solve alone, and gives people decision support through predictions. The examples are forecasting, financial markets, and choosing hyperparameters for new models (AutoML) §3.1 p. 639. In another setting, AI produces an output that a human evaluates; the example given is a model that reads CT scans and helps a physician make a diagnosis §3.1 p. 639.

4. Human intelligence in the loop of AI §3.2 p. 639–640. Humans teach AI systems. Tasks named include setting or tuning hyperparameters, training and debugging models, and interpreting unsupervised results such as clustering §3.2 p. 639. The paper notes that interactive learning often needs large amounts of labelled data supplied by people, and that human input is especially valuable when little data is available §4 p. 640. Human game play is named as an input for training reinforcement-learning robots §4 p. 640.

5. Roles fig. 2 p. 640. Fig. 2 shows two arrangements. In augmented human intelligence, the AI is the teacher and the person learns. In augmented machine intelligence, the person is the teacher and the AI learns.

6. Definition of Hybrid Intelligence §4 p. 640. The paper defines it as "the ability to achieve complex goals by combining human and artificial intelligence, thereby reaching superior results to those each of them could have accomplished separately, and continuously improve by learning from each other" §4 p. 640. The definition has three parts:

   • Collectively: the activities are performed together, so they depend on each other. Their goals need not be the same §4 p. 640.
   • Superior results: the combined system should do a task better than any of its parts could, with each part's contribution given to the agent best suited to it §4 p. 640.
   • Continuous learning: the whole system and each part improve through shared experience, so both the human and the AI learn from each other §4 p. 640. The paper cites a previous 2019 publication by the same authors for this definition §4 fn. 1 p. 640.

7. Advantages for humans and organisations §5 p. 641. The paper argues that people can learn from AI, for example by generating new knowledge and by passing expert knowledge to novices without social interaction §5 p. 641. Teaching the AI lets people control what it learns and make its inferences follow criteria they can interpret, which helps adoption and can exclude biases §5 p. 641. Co-creating with an AI may create a sense of ownership and increase acceptance and trust §5 p. 641.

8. Example p. 641. The paper gives AlphaGo as an example. It learned from expert human moves and then improved through further training, and it played moves that human players had not tried p. 641. The example is cited to a published study by the AlphaGo team, not to a result of this paper p. 641.

9. Research directions §6 p. 641–642.

   • Trust: the goal is a balance between trust and distrust, not maximal trust. The authors propose interfaces that show a system's state and needs in a form humans can understand. They point to semi-autonomous driving as an example and to a People + AI Research group at Google §6 p. 641–642 [fn. 3].
   • Governance: which mechanisms can train and maintain hybrid systems, and which incentives motivate human teachers. The authors compare monetary rewards with social rewards on micro-task platforms §6 p. 642.
   • Digital work: new forms of work such as internal crowd work that draws on the knowledge of experts across a company, and the education needed for them §6 p. 642.

10. Conceptual integration fig. 3 p. 642. Fig. 3 places Hybrid Intelligence as the overlap of human intelligence and artificial intelligence, with collective intelligence as a region inside the human part fig. 3 p. 642.

Hyperparameters

Not applicable. The paper has no model, training setup or experiment, and no numerical settings. Hyperparameters are not stated anywhere in the paper §6.

Results

No experimental results. The paper reports no measured performance, dataset, baseline or sample size. Its quantitative-sounding content is background (the AlphaGo example p. 641 and the statistical-prediction evidence p. 639), and these are cited to other works. The claim that Hybrid Intelligence yields superior results is a definition and a prediction §4 §1, not a measured outcome.

Paper vs code

No official code.

Searched: the paper's footnotes link only deepmind.com and ai.google p. 641 p. 642, and the paper links no code repository or project page. GitHub repository search for "dellermann" returned no results. A search for "hybrid intelligence" returned no repository by the authors; the closest was a reading list on human–AI collaboration by another user, which is not an official repository.

Pitfalls

• Definition, not method. Nothing here can be implemented as written. The definition of "superior results" §4 gives no test for whether a combined system is better than its best part, and no metric or threshold is named.
• The arXiv date and the paper date differ. The arXiv record is dated 2021-05-03 (v1), but the paper was published online on 28 March 2019 in Business & Information Systems Engineering p. 637. Cite both if you need a year.
• Term used in a specific sense. "Hybrid Intelligence" here means the combination of human and machine agents with mutual learning §4. Other fields use the same phrase for other things. Search results for "hybrid intelligence" are dominated by unrelated projects (for example, hybrid search and knowledge-graph systems).
• Figures are the authors' illustrations. Fig. 1 and Fig. 3 are diagrams that organise the text. The paper cites no data source for the strengths in Fig. 1 fig. 1 p. 640.
• Cited support is secondary. Several claims rest on cited work the paper does not reproduce: the dual-process theory §3 p. 639, the statistical-prediction result §3 p. 639 and the AlphaGo example p. 641. Check those sources before relying on them.
• Tasks with no ground truth. The authors say that complex managerial problems are time-variant, need domain knowledge and have no specific ground truth §6 p. 641. That makes outcome-based evaluation of such systems hard, and the paper proposes no alternative.
• Trust and governance are open questions. Section 6 poses them as research agendas. It does not answer them.

Lineage

• Builds on: general definitions of intelligence and collective intelligence §2 p. 637–638; dual-process theory §3 p. 639. The paper cites these works but they are not on this wiki.
• Compared against: none in this paper.
• Superseded by: not stated.
• Follow-up work by the authors: the paper's footnote points to Dellermann et al. (2019) for further work on this topic §4 fn. 1 p. 640.