Showing posts with label complexity. Show all posts
Showing posts with label complexity. Show all posts

Tuesday, December 14, 2010

Arguments from Nature

#entarch @G_Doherty of @theopengroup (via @tetradian ) suggests that we can get advice from Mother Nature.

"In nature, complexity abounds; but nothing is ever more complex than it needs to be." EA - Being Fit is Overrated (13 December 2010)

This is circular: the only way we know what nature thinks to be necessary is by observing what exists in nature. (Is the camel necessary?) It is also misleading: nature sometimes takes a very long time to decide what kinds of complexity to keep. (Are humans necessary?)

Nature has two largely independent processes: one to produce variation (using mutation and/or sexual reproduction), and one to eliminate unfit variations (known as natural selection). What we observe at any timepoint in natural history is the emergent consequences of the interaction between these two processes. Over millions of years, overall biological complexity has increased, but a vast number of evolutionary paths have ended.

Garry Doherty supports his argument with a quote often implausibly attributed to Darwin, but which is now thought to have been invented by Leon C. Megginson, a management sociologist who died in February 2010.

“It is not the strongest of the species that survives, nor the most intelligent that survives. It is the one that is the most adaptable to change.” [See Wikiquote, Darwin Correspondence Project] [@ColinPurrington has some photos of the misuse of this quote in his Darwin on the Floor LHAO]

As a statement of natural history, this is just not true. The horseshoe crab has remained largely unchanged for over 400 million years. Doherty also appears to misunderstand the word "fit", which doesn't mean strongest or most attractive, but is about the alignment between the species and its environment. As Bateson pointed out, the alignment (fit) survives even as the species themselves evolve - which allows us to understand the motto "survival of the fit" at a higher logical level. Nevertheless, Megginson's version of evolution may have been influenced by a misunderstanding of Bateson, who once remarked:
"The fight is not only to the strong or to the well adapted, it is also to the flexible."
Gregory Bateson, 'The New Conceptual Frames for Behavioural Research' Proceedings of the Sixth Annual Psychiatric Institute (Princeton NJ: New Jersey Neuro-Psychiatric Institute, September 17, 1958) reprinted in G. Bateson, A Sacred Unity: Further Steps to an Ecology of Mind (edited R.E. Donaldson, New York: Harper Collins, 1991) pp 93-110

But the facts about adaptability in natural history simply aren't relevant to the question of adaptability in some other domain, such as human organizations. It's just a metaphor, not a source of transferable knowledge.

Doherty thinks there is a real lesson for Enterprise Architects - as if enterprise architects should copy nature and adopt her principles. But even if we could correctly interpret nature's intentions, there is no obvious reason why we should limit ourselves to nature's methods. After all, farmers have been interfering with natural selection for thousands of years, producing plants and animals more suited to human requirements. The resulting ecosystems may sometimes appear more complex than nature alone would have produced, but sometimes they are alarmingly lacking in biodiversity; we can learn from nature but we cannot copy her.

Doherty thinks that "the outcomes of TOGAF™ and evolution are similar". Evolution produced a lot of dinosaurs (and excellent creatures they were too) before it got around to producing us. Be careful about learning from analogy.


See also Nick Matzke, Survival of the Pithiest (September 2009)

Related posts: The Shelf-Life of Algorithms (October 2016), Explaining Natural Selection (January 2021)

Updated 26 October 2016


Tuesday, January 20, 2004

Complexity: Devious Management and Investment Risk

cross-posted from System Viability and Corporate Governance



A common feature of much recent malfeasance is the construction of highly complex corporate structures, apparently beyond the legitimate demands of Requisite Variety.

Complexity – whether requisite or otherwise – adds to investment risk. Dodgy management practices may cause a continuous erosion of corporate value, or they may trigger a sudden collapse of value (Enron, Parmalat). Some companies have a sufficiently robust business model that they remain viable even with a certain level of malfeasance. Other companies turn out to be merely pseudo-viable – only remaining solvent thanks to dodgy accounting. Some investors may be willing to tolerate erosion, but do not wish to be confronted with sudden collapse.

Complexity is (or should be) a warning sign. The purpose of complexity is what it does. If it doesn’t serve a legitimate purpose, then it is surely reasonable to assume it is there to serve some other agenda.

Using the theory of complexity, we should be able to construct geological maps of the corporate world, showing (probabilistically) where it might be worth drilling for the next accounting black hole.

For example, it now seems that Parmalat was non-viable, only sustained in pseudo-viability by paper cashflows from a non-existent bank account. But such transactions can only be concealed by having lots of apparently genuine intra-company transactions. There is therefore a control mechanism that forces complexity onto the company at the operational level, and a higher level mechanism that manages the smoke and mirrors. It might not be easy to detect the fraud by looking at the operational company alone; it may be the existence of the control mechanisms that gives the game away.

Conversely, if a management is obliged to construct and present evidence of its bona fides, this evidence needs to include a properly grounded account of the control mechanisms, including a justification of the degrees of complexity and intracompany coupling.