c-ECO INSTITUTESYSTEMIC INTELLIGENCE LIBRARY · GOV

c-ECO SYSTEM / DOMAIN LIBRARY

GOV · Domain knowledge

Governance & Public Administration

Risks · Response · Governance · Calibration
Scenarios · Recovery · Sources

c-ECO Institute crest

A domain library connecting systemic risks, monitoring, governance and recovery. Explore nine parts and 35 sections with mechanisms, observations, evidence matrices and documented cases.

English research and learning edition · Scientific references, domain cases and reproducible exercises. Methodological notes →

READING AND EVIDENCE

How to use this library

The library combines domain research, a c-ECO analytical teaching structure and original exercises. References identify mechanisms, methods and documented cases; inclusion does not validate a complete TFP application.

N1 · Analytical and simulated material
The risk–TFP associations, candidate observations, scenario designs and exercise parameters organize inquiry. They are not measured local results, approved operational thresholds or estimates of event frequency. The case must define its function, observations and criteria.
N2 · Reproducible laboratory
Section 20 specifies a synthetic model, assumptions, dependence and random seed. Its Q output is a pedagogical index, separate from SPS. Numerical summaries describe only that declared experiment.
N3 · Sources and scope
Research papers, official documents and case records have distinct roles. This is a curated teaching library, not an exhaustive systematic review. Dynamic sources require a cited version or extraction date; applicability of a legal or technical instrument depends on the actual jurisdiction and activity.
N4 · Governance and learning
The library establishes no statutory power, quorum, emergency command, provider certification, partnership or institutional endorsement. A learning case may be real or simulated. Completion, optional credentialing, permission to submit and licensing remain distinct. Projects and data contributions to the SIL require an associated fellow and applicable review.

PART I

Domain intelligence profile

SECTION 01

Domain overview and system boundary

A governance case starts with a public function and a population affected by its performance. Define the decision boundary before selecting indicators: a municipality may control drainage maintenance while upstream land use lies elsewhere. Separate institutional inputs, administrative outputs and social outcomes. An agency can process more applications while exposure continues to increase. The analytical task is to connect the authorized decision to the mechanism producing harm and identify whose experience is absent from the record. [G01] For the case, draw the boundary around one consequential decision and list the groups that experience its effects.

Governance concerns how societies define public problems, authorize decisions, distribute responsibilities, resolve disputes and learn from consequences. This domain examines the institutions connecting evidence to collective action across municipal, regional, national and transboundary scales. Its unit of analysis may be an agency, policy process, public-service network or shared resource regime. Formal mandates, informal practices, administrative capacity and the distribution of voice must be studied together. [G01] [G06]

Anticipatory governance asks whether institutions can recognize deterioration and act while meaningful choices remain. A technically accurate forecast has little protective value when no authorized actor receives it, resources cannot be mobilized, or affected communities cannot contest its assumptions. The library therefore connects decision latency, credible evidence, procedural legitimacy and recovery capacity without equating a performance score with lawful authority. [G07] [G11]

The educational case should specify the public function, affected population, jurisdiction, decision horizon and plausible irreversible consequences. Examples include flood preparedness, land-use decisions, environmental licensing, continuity of essential services and stewardship of shared resources. Comparative institutional findings are starting hypotheses for local inquiry; they do not establish that any country, agency or community should adopt a predetermined governance model. [G08] [G12]

A domain label is not yet a case boundary. Separate the condition of a resource or asset from the function delivered to users. A nominally available installation may fail to deliver usable service, and a system-wide average can conceal localized loss. Preserve the original physical or institutional unit alongside any normalized representation. The boundary should make it possible to ask what enters, what changes, what leaves and who experiences the consequences.

Case-analysis method
Case fieldRecord
FunctionDescribe the outcome delivered, affected users and the minimum useful unit of service.
BoundaryRecord spatial, technical, organizational and temporal boundaries, including excluded processes.
Reference conditionState what counts as functional performance and which evidence defines that condition.
Exposure and distributionIdentify which groups, assets and ecological functions can be affected differently.
DependenciesIdentify prerequisites, substitutes and common points of failure.
ObservationConnect each important claim to a source, method, scale and update interval.

Section readings [G01]

SECTION 02

Historical development and changing conditions

Governance scholarship moved beyond a simple choice between centralized government and markets toward institutional diversity, collective action and adaptive arrangements. This history matters because the same formal reform can work differently under different resource conditions, norms and power relations. Polycentricity describes multiple interacting centers of decision; it does not establish that fragmentation is beneficial. Compare the mechanism a reform is expected to change with the actual information, incentives and dispute-resolution arrangements available. [G10] Ask whether decentralization creates meaningful local authority or merely transfers responsibility without capability.

A historical baseline must be examined for changes in exposure, technology, operating practice and observation. Compare episodes using their mechanisms and evidence, rather than treating all events with a similar label as exchangeable observations. A reconstruction should show what was known at each time; later explanations should not be presented as information available to the original decision maker. Recovery and long-term change may require a separate timeline from the initiating incident.

Historical comparison: documented records for further study
Case and periodMechanism to examineComparison questionSource
Hurricane Katrina, United States, 2005Ambiguous responsibilities and insufficient integrated capacity complicated responseTrace authority, resources and handoffs across levels[G15]
Flint water crisis, United States, 2014–2016Oversight weaknesses and delayed response to evidence prolonged the crisisCompare information custody with the authority and duty to act[G16]
Grenfell Tower fire, United Kingdom, 2017; inquiry 2024The inquiry examined systemic failures across construction, regulation and public bodiesReconstruct how warnings and responsibility were distributed[G17]
Space Shuttle Columbia, United States, 2003Technical damage and organizational conditions jointly contributed to the lossStudy how uncertain technical concerns entered management decisions[G18]

Section readings [G10]

SECTION 03

Actors, institutions and decision responsibilities

Map institutions by function rather than reputation: standard-setting, authorization, implementation, evidence custody, representation and review. A ministry, municipality, professional body and community organization may contribute different forms of knowledge while holding different powers. Collaboration works through specific arrangements and relationships; a meeting list is insufficient evidence of joint capacity. Record membership, decision rights, information duties and how unresolved disagreement is handled. This mapping makes it possible to test whether critical tasks have accountable owners. [G03] Identify one task with several contributors and determine who can lawfully make the final decision.

Map actors by the function they perform and the responsibility they actually hold in the case. The same organization may observe a condition, supply a service and participate in a decision; those roles should remain distinguishable. Examine information access, resources, expertise, affected users and accountability together. A list of institution names is not an operating governance arrangement. Record the evidence for each responsibility and the process for resolving a disagreement or correcting a record.

Case-analysis method
FunctionActors to identifyReviewable output
ObserveOperators, observation networks, laboratories and affected usersTimestamped records and methods.
InterpretAnalysts and relevant subject specialistsMechanism hypotheses, alternatives and uncertainty.
ReviewQualified reviewers with declared interestsDocumented assessment and unresolved disagreements.
Decide and executeThe actor with the applicable mandateReasons, authorized action and verifiable completion.
CommunicateResponsible institutions and accessible public channelsMessage, receipt, corrections and feedback.
UpdateData custodians and the review functionVersion, new evidence and conditions for revision.

Section readings [G03; C07]

PART II

Systemic risk intelligence

SECTION 04

Primary systemic risks

Primary governance risks arise when public institutions cannot recognize, authorize or implement necessary action. A backlog is a capacity mechanism; capture concerns distorted influence; exclusion concerns who can exercise rights or access services. These require different observations and remedies. Avoid collapsing them into a single governance score without explaining causal pathways and normative choices. For each risk, identify the affected function, the decision window, evidence of deterioration and feasible corrective action. [G11] Distinguish a missing rule from failure to implement an existing rule, because the remedies differ.

The inventory is a structured set of research hypotheses. It separates a threatening condition from the mechanism of loss and from its consequences. The proposed TFP association indicates which question to investigate; it is not evidence that a particular indicator predicts the event. Risk importance depends on the defined function, exposure, duration and usable alternatives. Do not infer frequency, severity or priority from the position of a row in the table.

Thirty domain-specific risk hypotheses
#Risk or threatening conditionMechanism to examineProposed TFP inquiry
1Unclear mandateSeveral agencies assume another owns the decisionP: distance from an unowned critical decision
2Conflicting mandatesSafety, development and service goals lack an agreed reconciliation processP; σ: contested objectives
3Decision backlogDemand persistently exceeds processing capacityΔV: backlog growth
4Evidence suppressionAdverse findings fail to enter the decision recordσ: hidden uncertainty
5Regulatory captureRegulated interests dominate framing or enforcementP; Lr: impaired correction
6Procurement lock-inEssential services depend on one difficult-to-replace contractorLr: substitution constraint
7Emergency power overreachTemporary measures lack review and expiry safeguardsP: rights exposure
8Administrative exclusionEligibility or documentation rules exclude affected residentsP: unequal service loss
9Jurisdictional fragmentationConsequences cross boundaries without coordinationΔV: delayed collective response
10Budget execution failureApproved resources cannot be lawfully mobilized when neededLr: deployment delay
11Staff attritionSpecialist knowledge leaves faster than it is replacedΔV: capability erosion
12Corrupt allocationDecisions divert resources from declared public prioritiesP; σ: unreliable records
13Unreviewable automationAutomated decisions lack reasons or effective challengeσ; Lr: correction barriers
14Missing public recordsDecision evidence cannot be reconstructedσ: provenance deficit
15Consultation fatigueRepeated requests produce little visible influenceLr: weakening cooperation
16Disinformation escalationUnverified narratives displace verified service guidanceΔV: correction lag
17Politicized risk communicationWarnings change with political incentives rather than evidenceσ: credibility loss
18Inconsistent enforcementComparable cases receive unexplained different treatmentP: fairness deficit
19Unfunded responsibilitiesMandates expand without usable capabilityP; Lr: execution mismatch
20Weak appeals accessAffected people cannot challenge errors promptlyLr: persistent harm
21Conflict-of-interest failureDecision participants assess matters in which they hold material interestsσ: independence deficit
22Uncoordinated recoveryParallel assistance creates gaps and duplicationLr: fragmented restoration
23Emergency procurement failureSpeed bypasses necessary traceability and fitness checksP: unsuitable delivery
24Indicator gamingTargets improve while underlying service deterioratesσ: measurement distortion
25Delayed risk escalationCredible warning reaches authority after the action windowΔV: shrinking lead time
26Intergovernmental data blockadeAgencies cannot exchange necessary lawful informationσ; ΔV: stale assessment
27Policy reversal instabilityFrequent reversals interrupt long-term service commitmentsLr: investment discontinuity
28Rights-infringing disclosurePublic records expose sensitive personal informationP: irreversible privacy loss
29Neglected maintenance governanceNo actor owns routine upkeep or renewalΔV: accumulated degradation
30Unclosed recommendationsReviews recur without verified corrective actionLr: repeated failure

Section readings [G11]

SECTION 05

Amplification mechanisms and secondary risks

Amplification occurs when a weakness changes the effect of another disturbance. Staff turnover may be manageable until an emergency creates an intake surge; fragmented records become more damaging when several agencies must coordinate immediately. Assess combinations rather than adding unrelated risk scores. A useful case comparison holds the initiating disturbance constant and changes coordination or capacity assumptions. Examine who bears additional delay and whether the amplification is reversible within the available response window. [G06] Trace one feedback loop in which administrative delay increases the workload that generated the delay.

An amplifier changes the consequences of an initiating condition without necessarily causing the initiating event. Useful counterfactuals hold the threat constant and vary concentration, maintenance, access, information or response capacity. Document the mechanism and the observation that would distinguish it from an alternative explanation. Several amplifiers may share the same upstream cause; counting each one as independent evidence exaggerates confidence.

Amplification mechanisms
AmplifierPropagation mechanismEvidence or TFP inquiry
Fragmented recordsDifferent agencies see incompatible versionsReconcile identifiers and preserve correction history
Political turnoverTacit commitments and expertise disappearMaintain lawful continuity and documented handover
Unequal digital accessOnline-only service hides unmet demandProvide accessible alternative channels
Emergency workloadRoutine capacity assumptions fail simultaneouslyExercise surge arrangements and prioritization
Contract concentrationOne supplier disruption affects multiple servicesMap beneficial ownership and shared dependencies
Opaque metricsTargets hide exclusions and adverse distributionPair aggregate and disaggregated outcome measures
Weak complaint protectionAffected people withhold early signalsUse confidential channels and protect due process
Short planning horizonsBenefits of prevention appear outside electoral cyclesDocument long-term consequences and review obligations

Section readings [G06]

SECTION 06

Emerging risks and research horizons

Emerging governance risks involve changed combinations of technology, institutions and behavior. Automated drafting can increase speed while obscuring the origin of a factual claim; platform-mediated public participation can widen access while making representation harder to interpret. Novelty alone does not establish severity. Evaluate exposure, affected rights, verifiability and the feasibility of correction. Keep the intended public function visible so that technological adoption is judged against service and accountability outcomes rather than the volume of automated activity. [G12] Specify how a human reviewer would detect and correct a consequential error before it spreads.

A research horizon is tied to the time needed to investigate, prepare or change a system. It is not a date at which an emerging threat is predicted to occur. Record the reason for concern, the strength of evidence, the exposed function and the observation that would change the priority. Distinguish a newly observed mechanism from a known mechanism whose exposure, scale or institutional context is changing.

Emerging research agenda
Research topicMechanism or knowledge gapObservation or horizon question
Generative administrative systemsPlausible but unsupported outputs enter official reasoningRequire provenance and human responsibility
Synthetic public submissionsAutomated participation distorts apparent consensusAssess representation without excluding legitimate collective voice
Platform dependencyPublic service delivery inherits private platform interruptionsTest accessible continuity routes
Climate-driven relocation governanceJurisdiction, tenure and service responsibilities shiftUse participatory planning and rights safeguards
Real-time decision dashboardsRapid indicators outrun lawful review and contextual interpretationSeparate observation from authorization
Cross-border data restrictionsEssential coordination meets privacy and sovereignty constraintsDesign lawful minimal-purpose exchanges

Section readings [G12]

SECTION 07

Cascades and cross-domain dependencies

A cascade is a sequenced transmission of disruption across functions. An energy outage can disable a public registry, interrupt benefit verification and increase demand at local service offices. Shared causes and causal propagation should be distinguished: two failures occurring during a flood may be independently exposed rather than mutually dependent. Construct a time-ordered pathway with necessary interfaces, alternative routes and potential interruption points. Use observed timing and service records to test the proposed links. [G14] Identify which link can be interrupted through an authorized administrative decision and which requires another sector.

Authority can be distributed across several bodies while accountability remains unclear. An actor map should distinguish legal power, operational capability, information custody and the ability to impose or review decisions. The same organization may occupy several roles, but each role needs an explicit evidentiary and procedural boundary. [G11]

Administrative queues convert growing demand into delay. When new cases arrive faster than trained staff can process them, backlogs expand and urgent cases compete with routine work. Average processing time can conceal a small group facing extreme delays; age distributions and priority rules reveal this mechanism more clearly.

Participation changes the information available to decision-makers only when participants can influence problem framing and challenge evidence. Attendance counts do not demonstrate representation or influence. Examine selection, language accessibility, disclosure of disagreement and whether reasons for accepting or rejecting proposals are recorded. [G09]

For each directed dependency, specify the function supplied, the destination, the propagation time and the substitute. Shared-cause failure, interacting threats and cascading propagation are different structures. A directed arrow becomes an explanatory claim only when the timing and mechanism are supported. Test apparent redundancy by removing the common access route, platform, energy supply or specialist on which both alternatives depend.

Directed dependency hypotheses
DependencyMechanism and directionVerification or TFP inquiry
Water and sanitationService disruption changes administrative demand and health burdenCoordinate service evidence and public guidance
EnergyPower interruption disables offices and digital servicesTest continuity of essential decisions
HealthHealth alerts require timely intergovernmental actionDefine evidence and authority interfaces
Food systemsSupply disruption changes assistance prioritiesAlign eligibility and logistics information
FinanceLiquidity and execution rules constrain public responseDistinguish approved resources from deployable resources
InfrastructureAsset safety depends on licensing and maintenance oversightTrack ownership of safety decisions
Digital systemsIdentity, records and communications depend on shared platformsPreserve offline continuity and recoverable records
Land and urban systemsPlanning decisions create long-lived exposureEvaluate cumulative and distributional consequences
Scientific observationPolicy depends on timely interpretable evidenceDocument uncertainty and independent scrutiny
Strategic resilienceEmergency coordination can affect civil rights and essential servicesMaintain proportionality, oversight and civilian protection

Section readings [G14; C01; C02]

PART III

Systemic response intelligence

SECTION 08

Readiness and response protocols

Response protocols need an observable trigger, an accountable recipient and a proportionate action that the recipient is authorized to take. A dashboard color alone supplies none of these. Define acknowledgement, evidence review, temporary safeguards and reassessment conditions in a decision record. The protocol should work when the primary official is unavailable and should preserve access for affected people. Exercise the sequence using realistic workloads and incomplete information rather than assuming that every notification will be read immediately. [G15] Measure elapsed time from credible evidence to action, including legal and operational handoffs.

Preparedness connects a signal to a responsible actor, an available measure and a condition of completion. This learning architecture does not grant emergency command or operational authority to the c-ECO Institute or a course participant. A useful protocol distinguishes checking the signal, protecting exposed functions and verifying recovery. A paper plan contributes to usable capacity only when its relevant assumptions have been tested.

Case-analysis method
StageAction to prepareEvidence
PrepareDefine critical functions, contacts, alternatives and observation coverage.A tested readiness record.
VerifyCheck the signal, the instrument and plausible alternative explanations.A traceable observation and uncertainty statement.
ProtectSelect and implement measures within the responsible actor’s authority.Coverage of priority functions and evidence of execution.
RecoverVerify usable performance before treating the function as restored.Recorded return criteria, monitoring and decision owner.

Section readings [G15]

SECTION 09

Scientific review and decision records

Escalation means transferring a decision to an appropriate level when current capability or authority is insufficient. It should not create an informal power that bypasses existing law. Identify what evidence accompanies escalation, who accepts responsibility and how urgent interim protections remain reviewable. The same principle applies to technical review: independent challenge improves scrutiny only if reviewers have relevant expertise, timely information and a route for resolving disagreement. Records should preserve minority reasoning when it matters to the decision. [G11] Test an escalation in which the preferred decision-maker is unavailable and evidence remains contested.

A review record separates observation, inference and decision. Record the data version, methods, alternative explanations, relevant expertise, conflicts of interest and unresolved disagreement. Review should be matched to the question and its consequences. Scientific analysis can inform a competent actor without replacing that actor’s mandate. No membership size, quorum or institutional power is established by this teaching library.

Case-analysis method
Review itemQuestion and record
QuestionWhat specific claim is being evaluated?
EvidenceWhich observations, sources and transformations support it?
AlternativesWhat other process could explain the same observation?
IndependenceWhich interests or shared data origins affect review?
DecisionWho can act, on what basis and with which constraints?
RevisionWhat new observation or failure of an assumption reopens the analysis?

Section readings [G11; C05; C07]

SECTION 10

Communication and observation continuity

Communication is part of implementation. A technically sound message may fail if recipients cannot access the channel, understand the language or identify the required action. Distinguish warning issuance, receipt, comprehension and practical ability to comply. Acknowledge material uncertainty with an explanation of what will change the advice. Corrections should remain connected to earlier messages so people can reconstruct the current guidance. Community feedback can reveal implementation barriers absent from central records. [G07] Evaluate one warning through a user journey from receipt to feasible protective action.

Continuity of observation should be tested alongside continuity of the function itself. Losing data may increase uncertainty before the physical process visibly changes. Redundancy must be demonstrated against common causes, including power, location, communications, credentials and specialist availability. During disconnected operation, preserve the last reliable observation, record the uncertainty that follows and reconcile timestamps and authorship when information paths return.

Case-analysis method
Continuity capabilityTest
Observation pathTest sensor availability, power, timing and independent confirmation.
Alternative communicationTest actual reach, autonomy and the ability to contact responsible people.
Degraded operationSpecify what can remain usable safely under loss of information or connectivity.
Offline recordKeep controlled copies of essential maps, contacts, definitions and procedures.
Accessible messagesCheck language, disability access, delivery and routes for correction.
ReconciliationPreserve timestamps and authorship when disconnected records are merged.

Section readings [G07; C01]

PART IV

Governance and legal architecture

SECTION 11

International instruments and technical references

International instruments shape expectations and cooperation, but their legal effect depends on the instrument, jurisdiction and applicable domestic arrangements. The Sendai Framework supplies policy priorities for disaster risk reduction; it does not itself grant a local research project emergency powers. Comparative governance analysis should distinguish binding obligations, recommendations and voluntary practice. Where consequences cross borders, examine notification, information exchange, participation and dispute-resolution procedures rather than presuming that a technical framework settles questions of sovereignty. [G14] Prepare a map of instruments relevant to the case and mark their legal or advisory status.

Classify each instrument before using it. A scholarly article supports an inference, a technical guide describes a method, a standard has a defined scope, and a legal instrument may create obligations only where applicable. The case record should identify the specific provision or method, its version and the activity to which it relates. A source’s institutional reputation cannot by itself establish applicability or demonstrate compliance.

Technical and institutional documents: identify their actual function
ReferenceDocumentUse and scope
[G13]OECD Principles on Water GovernancePublic-governance assessment reference; no institutional affiliation implied.
[G14]Sendai Framework for Disaster Risk Reduction 2015–2030Risk understanding, governance, investment and preparedness.
[G15]Catastrophic Disasters: Enhanced Leadership, Capabilities, and Accountability Controls Will Improve the Effectiveness of the Nation's Preparedness, Response, and Recovery SystemKatrina-related findings on authority, capacity and accountability.
[G16]Management Weaknesses Delayed Response to Flint Water CrisisEvidence escalation and oversight boundaries.
[G17]Phase 2 ReportRegulation, organizational responsibility and ignored evidence in building safety.
[G18]Columbia Accident Investigation Board Report, Volume IOrganizational conditions and technical evidence in an irreversible loss.
[G19]COVID-19: Make it the Last PandemicInternational warning, preparedness and coordination failures.

Section readings [G14]

SECTION 12

Jurisdiction-specific responsibilities and requirements

National and regional governance should be analyzed through the actual allocation of functions. An agency responsible for issuing a permit may not operate the asset or control emergency services. Administrative procedure, access-to-information rules, environmental duties and public-service responsibilities can intersect in one case. Record the current legal source and seek appropriate jurisdiction-specific interpretation where needed. Scientific evidence informs the decision but cannot replace the lawful process through which rights, duties and competing public objectives are reconciled. [G13] Compare formal responsibility with the actor that performs the task in ordinary practice.

The register should cover the actual activity and location, including interfaces between organizations and jurisdictions. Separate responsibility for observing, supervising, deciding and executing. Retain the official source, version consulted and evidence needed to assess a condition. Conflicting definitions and overlapping mandates are analytical findings to investigate. A general library cannot create a universal legal threshold for all settings.

Case-analysis method
Register fieldInformation to preserve
Instrument and versionOfficial title, scope, jurisdiction and date consulted.
Actor and functionThe competent authority, operator, owner or custodian for the relevant activity.
ConditionThe requirement, decision trigger or performance obligation actually applicable.
EvidenceThe observation or document needed to evaluate that condition.
InterfaceOverlaps, conflicts, shared duties and coordination procedures.
ReviewHow changes in the instrument, activity or evidence affect applicability.

Section readings [G13]

SECTION 13

Causation, accountability and cascading consequences

Accountability involves more than publishing a report. An actor must explain conduct to a forum able to question the explanation and produce consequences within its lawful remit. Distinguish political, administrative, professional and legal accountability because their evidence standards and remedies differ. In a harmful service failure, immediate continuity, compensation, disciplinary review and institutional learning are separate processes. A single investigation may contribute evidence without resolving all four. Analyze access to remedy from the affected person's perspective. [G11] Follow one error from complaint through review to a verified corrective outcome.

A technical chain of consequences is not automatically a legal allocation of liability. Separate evidence of causation from the duties, control and decisions relevant to each actor. A case may contain direct damage, dependent service interruption and persistent environmental or social consequences on different timescales. The analysis should show which links are documented and which need further investigation, without presuming an institutional restoration fund, mandatory levy or insurance mechanism.

Case-analysis method
LayerAnalytical question
Technical sequenceSeparate the initiating condition, failure mechanism, propagation and consequence.
Duty and controlIdentify the applicable responsibility and the actor able to influence the relevant process.
ExposureTrace the connection between a change of state and an affected function or population.
Alternative explanationsIdentify concurrent conditions and missing evidence relevant to attribution.
Recovery resourcesIdentify documented resources and their access conditions, without assuming an institutional fund or levy.

Section readings [G11]

SECTION 14

Cross-boundary coordination

Cross-boundary governance begins with an externality: a decision produces effects outside the decision-maker's jurisdiction or constituency. The appropriate response can involve an agreement, joint information system or defined consultation process, but collaboration itself creates transaction costs and possible exclusion. Compare the geographic extent of the hazard, service network and authority. Identify where upstream benefits and downstream harms are distributed differently. A durable arrangement needs a way to update evidence and address disputes without depending entirely on personal relationships. [G06] Specify what information each jurisdiction needs before it can make a defensible decision.

Processes and dependencies often cross administrative, organizational or national boundaries. Coordination requires compatible definitions, useful timing, authorized exchange and an identifiable decision interface. Sharing data does not by itself resolve disagreements over objectives, risk allocation or resources. An exercise should expose which decision can be coordinated under existing arrangements and which would require an additional agreement or competent determination.

Coordination across functional boundaries
Boundary / dependencyMechanism to coordinateCase record
Water and sanitationService disruption changes administrative demand and health burdenIdentify the actors, notification time, information definition and decision interface for this boundary.
EnergyPower interruption disables offices and digital servicesIdentify the actors, notification time, information definition and decision interface for this boundary.
HealthHealth alerts require timely intergovernmental actionIdentify the actors, notification time, information definition and decision interface for this boundary.
Food systemsSupply disruption changes assistance prioritiesIdentify the actors, notification time, information definition and decision interface for this boundary.
FinanceLiquidity and execution rules constrain public responseIdentify the actors, notification time, information definition and decision interface for this boundary.
InfrastructureAsset safety depends on licensing and maintenance oversightIdentify the actors, notification time, information definition and decision interface for this boundary.

Section readings [G06; C07]

PART V

TFP calibration intelligence

SECTION 15

Position (P): candidate observations

P should be operationalized through a defined unacceptable governance outcome and an observable margin to it. Examples include remaining lawful time before a critical decision deadline or the share of an affected population lacking essential service access. Do not infer proximity from a broad corruption or democracy index alone. A margin becomes interpretable only with the relevant obligation, population and decision horizon. Document whether the threshold is statutory, service-based, analytically proposed or an exercise assumption. [G01] Select a margin that a responsible actor can interpret and connect to a concrete decision.

P represents position relative to a specified loss of function. The raw observation, reference condition, direction of deterioration and boundary of failure must remain explicit. A candidate monotone transformation can help compare states within a defined case, but it does not establish the threshold or validate an aggregate index. Capacity, delivered performance and exposure may require different indicators even when they concern the same installation.

Thirty candidate observations for P and related case questions
#Candidate observationUnit or definitionInterpretation and data requirement
1Unassigned critical decisionscountRecord the decision, lawful authority and deadline; distinguish absent ownership from delayed assignment
2Median decision timedaysTimestamp receipt and final reasoned decision by case class
3Upper-tail decision timedays, 90th percentileUse comparable case cohorts; identify censored unresolved cases
4Backlog agedaysTrack oldest and distribution, not only total count
5New-to-resolved case ratioratio per periodDefine intake and closure consistently
6Mandate conflicts unresolvedcountRegister the conflicting provisions and competent resolution route
7Staff vacancy rate% authorized postsSeparate essential specialties from general staffing
8Specialist turnover% per yearFollow role-specific losses and replacement readiness
9Documented decision rationale coverage% sampled decisionsRequire reasons linked to evidence and authority
10Traceable evidence coverage% sampled material claimsCheck source, version and access permissions
11Public information response timedaysApply the relevant legal rules and exclusions
12Accessible consultation coverage% affected groups reachedAssess language, disability and digital access explicitly
13Participation influence traceability% substantive submissions answeredCode acceptance, rejection and reasons
14Appeal resolution timedaysDisaggregate urgency and remedy type
15Correction implementation rate% confirmed errors correctedCheck the actual remedy, not merely acknowledgement
16Recommendations overduecount and ageUse independent closure evidence
17Declared material interestscount by roleDisclosure count alone is not a corruption measure
18Recusal compliance% relevant decisions reviewedAudit documented handling against applicable rules
19Single-provider dependency% essential service volumeIdentify feasible substitutes and switching times
20Procurement exception frequency% awardsContextualize emergency authority and market conditions
21Service restoration timehours or daysMeasure verified minimum service to defined populations
22Unequal service interruptionhours by population groupProtect privacy and compare exposure differences
23Cross-agency exercise completion% scheduled exercisesDocument scenario, participation and unresolved actions
24Warning acknowledgement timehoursLink warning issue, receipt and authorized response
25Evidence-to-decision intervalhours or daysIdentify the earliest credible relevant evidence
26Data-sharing agreement coverage% necessary exchangesCheck legal basis, permitted purpose and functioning delivery
27Contingency role coverage% critical roles with ready substituteTest ability rather than names on a list
28Public correction publication delayhours or daysRecord error detection and accessible correction
29Policy review completion% reviews dueExamine whether findings changed implementation
30Community-reported unresolved harmscount and ageUse accessible channels; missing reports do not establish absence of harm

A didactic monotone transformation for an indicator that worsens as it rises is p = clip[(x − x_ref)/(x_failure − x_ref), 0, 1]. Reverse the direction for a reserve that deteriorates as it falls. The expression makes the reference points visible; it does not choose those points, prove comparability or establish an operational aggregate. Retain x in its original unit and justify the function separately for each case.

Section readings [G01]

SECTION 16

Velocity (ΔV): rates and trajectory

ΔV captures the direction and speed of institutional deterioration or recovery. Backlog growth, specialist losses and increasing warning acknowledgement time offer different signals and should retain their units. A growing queue may reflect improved access rather than worsening performance, so inspect arrivals, closures and case mix together. Estimate trends over windows appropriate to administrative cycles and report uncertainty. A short-term spike after a reporting reform should not automatically be interpreted as structural deterioration. [G05] Show how the interpretation changes when an apparent worsening follows improved complaint access.

ΔV describes direction and rate of change over a declared interval. Two systems at the same apparent position may have different reaction times because their trajectories differ. Compare rates using consistent units, observation windows and reference systems. Check seasonality, missing periods, reporting changes and process acceleration before extrapolating. A time-to-boundary calculation is conditional on its trajectory assumption; it is not a general forecast.

Ten families of rate-of-change observations
ProcessRate / unitInterpretation
Backlog accumulationcases/weekCompare arrivals and completions under stable case definitions
Decision delay growthdays/monthInspect case mix before attributing trend to capacity
Staff capability depletionqualified staff/monthAccount for absences, training and replacement
Warning lead-time contractionhours/dayCompare time-to-impact with evidence-to-action delay
Service access deteriorationpercentage points/monthDisaggregate population groups and channel changes
Appeals accumulationappeals/weekDistinguish increased access from increased errors
Recommendation closure lagdays/quarterTrack age cohorts rather than changing denominators
Provider concentration growthpercentage points/yearInclude linked suppliers and transition feasibility
Trust changesurvey points/yearUse repeated comparable instruments and uncertainty intervals
Coordination latency growthhours/exercise cycleTest the same cross-agency task under comparable conditions

Section readings [G05]

SECTION 17

Uncertainty (σ): evidence and model limits

Governance uncertainty includes incomplete records, disputed causal models and disagreement about acceptable outcomes. These are not interchangeable. Sampling more files may reduce measurement uncertainty while leaving a contested public objective unresolved. Preserve alternative explanations and identify what additional evidence could distinguish them. Structured deliberation can expose value disagreements without converting them into numerical error bars. The quality of the decision record depends on transparent reasoning, not simply on obtaining a narrow interval from a statistical model. [G12] Separate one factual uncertainty, one model uncertainty and one normative disagreement in the case.

Uncertainty should be recorded by object and source. Measurement uncertainty, sampling limitations, parameter uncertainty, model structure, future scenarios and institutional ambiguity cannot be replaced by one unsupported percentage. More simulation samples can reduce numerical sampling error without resolving a missing mechanism. Identify which uncertainty changes the decision and which further observation, comparison or test could reduce it.

Case-analysis method
Source of uncertaintyObject affectedTreatment
MeasurementInstrument error, drift, reference system and quality controls.Calibration, cross-check and traceable metadata.
SamplingSpatial, temporal or population coverage.A design matched to the decision and exposed groups.
ParametersValues weakly identified by available observations.Estimation, sensitivity and alternatives.
Model structureProcesses excluded or represented inadequately.Competing models and tests outside the fitting conditions.
ScenarioUncertain future demand, environment or operating practice.A declared set of plausible trajectories.
DependenceCorrelated conditions or failures treated as independent.Joint analysis and explicit common-cause hypotheses.
InstitutionsUnverified duties, access or resource availability.Documentary checks and mobilization tests.
Unknown mechanismsA plausible process with insufficient evidence.A research question and decisions robust to the unresolved gap.

Section readings [G12; C06]

SECTION 18

Reversibility liquidity (Lr): usable recovery resources

Lr concerns practical limits on restoring a public function or correcting harm. Restoring an office server may take hours while rebuilding records, correcting wrongful exclusions and re-establishing trusted access takes longer. Identify required staff, lawful authority, records, accessible channels and independent review. Recovery capacity is conditional on the wider disturbance: the same regional emergency may affect all mutual-assistance partners. Report the minimum service achieved and remaining exclusions instead of treating administrative reopening as full recovery. [G04] Identify the slowest necessary capability and test whether it constrains the entire recovery sequence.

Lr examines resources that can preserve, contain or recover the defined function within the relevant time. A resource listed in an inventory is different from a resource that is accessible, compatible, staffed and mobilizable. Record capacity, useful arrival time, duration, dependencies and evidence of testing. Avoid averaging away an essential bottleneck. Recovery of a service does not necessarily restore ecological condition, accumulated losses or public trust.

Recovery resources to verify in the case
Recovery resourceAvailability or mobilization questionVerification or dependency
Lawful decision registerRecoverable authorities, decisions and reasonsTest restoration of a sampled case end to end
Trained substitute staffRole-specific competency and availabilityExercise handover under workload
Accessible service channelsDigital, telephone and in-person alternativesVerify use by affected populations
Independent review capacityQualified reviewers without material conflictsDemonstrate timely case access and remedy
Community liaison networkLegitimate locally accessible communicationCheck reach beyond established organizations
Records recovery capabilityProtected backups and correction historiesReconstruct the authoritative version
Mutual-assistance arrangementsClear request, acceptance and responsibility termsTest realistic deployment and handback
Specialist interpretationTechnical and legal expertise for complex evidencePreserve reasoned disagreement
Procurement continuityLawful access to qualified alternative suppliersVerify fitness and switching feasibility
Corrective-action trackingOwners, deadlines and verified closure evidenceReopen actions when outcomes fail

Section readings [G04]

PART VI

Scenario and simulation intelligence

SECTION 19

Stress scenarios and comparative strategies

Scenario design should vary mechanisms rather than decorate a single forecast. Compare an ordinary demand surge, an interagency data interruption and a compound event combining staff absence with infrastructure failure. For each scenario, specify the initiating conditions, decision sequence and observable consequences. Include people who face greater barriers to official channels. A useful scenario reveals which intervention remains helpful across different plausible futures and which succeeds only because a convenient assumption was built into the exercise. [G03] Ask which assumption would have to fail for the preferred intervention to become ineffective.

A stress scenario states the initiating condition, prior state, time sequence, exposed function, shared dependencies and feasible responses. Its purpose is to reveal when a strategy loses usefulness and why. Compare alternatives across several conditions, including absent substitutes and simultaneous demand. Scenarios should lead to observations, tests and resource questions; assigning a precise event probability requires a separate justified model and evidence.

Five domain-anchored stress-test designs · N1
ScenarioInitiating mechanismObservation designStrategy comparison
A · Unclear mandateSeveral agencies assume another owns the decisionCheck which observation distinguishes onset, propagation and loss of the defined function.Compare current practice, improved readiness and a structural alternative; remove one shared prerequisite.
B · Evidence suppressionAdverse findings fail to enter the decision recordCheck which observation distinguishes onset, propagation and loss of the defined function.Compare current practice, improved readiness and a structural alternative; remove one shared prerequisite.
C · Budget execution failureApproved resources cannot be lawfully mobilized when neededCheck which observation distinguishes onset, propagation and loss of the defined function.Compare current practice, improved readiness and a structural alternative; remove one shared prerequisite.
D · Inconsistent enforcementComparable cases receive unexplained different treatmentCheck which observation distinguishes onset, propagation and loss of the defined function.Compare current practice, improved readiness and a structural alternative; remove one shared prerequisite.
E · Delayed risk escalationCredible warning reaches authority after the action windowCheck which observation distinguishes onset, propagation and loss of the defined function.Compare current practice, improved readiness and a structural alternative; remove one shared prerequisite.

Section readings [G03]

SECTION 20

Reproducible simulation and sensitivity analysis

Quantitative simulation can explore queues, staffing availability and decision timing when assumptions are explicit. Arrival rates and service times should be estimated by case type, while urgent decisions may require distinct priority rules. Correlated absences or simultaneous agency failures should not be modeled as independent without justification. Outputs describe the modeled system, not an automatic forecast of institutional collapse. Retain the model version, random seed, data exclusions and alternative specifications so another analyst can reproduce the exercise. [G05] Compare a baseline queue with a surge and explain the practical meaning of the longest delays.

Simulation is an explicit transformation of assumptions. Input distributions, dependencies, parameter estimation, output definition and testing must be documented. Numerical convergence does not establish model validity. Examine sensitivity to the function used, the weights selected, dependence assumptions and conditions outside the fitting data. The reproducible laboratory below is a synthetic exercise, separated from SPS and from any claim about real-event frequency.

Reproducible synthetic laboratory · N2
ElementSpecification
Samples and seed10,000 samples; Python Random; seed 2069881387.
Reference centersP = 0.72; ΔV = 0.62; σ = 0.40; Lr = 0.38.
Latent dispersion0.40, 0.45, 0.30, 0.40, respectively.
Common-factor loading0.65, 0.55, 0.35, −0.45, respectively.
Dependence constructionz_j = a_j g + √(1 − a_j²) ε_j; g and ε_j are independent standard normal draws.
Bounded transformationx_j = logistic[logit(m_j) + s_j z_j].
Learning outputQ = 0.35P + 0.25ΔV + 0.15σ + 0.25(1 − Lr).
Comparison conditionQ ≥ 0.70, selected only for this synthetic laboratory.
Calculated outputs under the declared assumptions
StatisticValue
Mean0.617
5th percentile0.513
Median0.619
95th percentile0.711
Fraction with Q ≥ 0.707.40%

The factor loadings define association on the latent scale. Correlations after the nonlinear transform should be estimated from the simulated samples. Q is a teaching index and is not SPS. Its exceedance fraction concerns the generated sample under these assumptions; it is not the probability of a real event or a forecast over a stated number of years. A temporal forecast would require a separately specified process and observation model.

Reproduce the calculation in Python
from random import Random
from math import log, exp, sqrt
from statistics import mean
rng = Random(2069881387)
m = [.72, .62, .40, .38]
s = [.40, .45, .30, .40]
a = [.65, .55, .35, -.45]
q = []
for _ in range(10000):
    g = rng.gauss(0, 1)
    x = []
    for mj, sj, aj in zip(m, s, a):
        z = aj*g + sqrt(1-aj*aj)*rng.gauss(0, 1)
        x.append(1/(1+exp(-(log(mj/(1-mj))+sj*z))))
    p, v, u, lr = x
    q.append(.35*p+.25*v+.15*u+.25*(1-lr))
q.sort()
print(mean(q), q[499], (q[4999]+q[5000])/2, q[9499])
print(sum(x >= .70 for x in q)/len(q))

Sensitivity exercise: remove the common factor, vary one dispersion, change the weight of recovery resources, and compare the ranking of the selected strategies. Then state which domain observations would be needed to replace each illustrative assumption. Use a suitable estimator when inputs are dependent; the common-factor experiment is a dependence check, not a claim that a particular Sobol estimator applies unchanged.

Section readings [G05; C03; C06]

SECTION 21

Restoration and performance verification

Recovery simulation should model dependencies among administrative tasks. Restoring a benefit system may require identity records, trained staff, accessible contact channels and a lawful exception process for lost documents. Optimizing total throughput can leave vulnerable groups waiting longest, so examine both speed and distribution. Compare recovery strategies against a common service objective and constraint set. Record whether temporary workarounds create errors that must be corrected later and whether those costs change the apparent advantage of rapid reopening. [G09] Evaluate recovery using the experience of a group missing from ordinary digital records.

Restoration follows prerequisites and verification conditions rather than a universal fixed clock. Tasks may proceed in parallel only where they do not compete for the same people, access, equipment or information. Protect essential functions while the critical path is addressed. Define what is measured before returning service, who can make that determination and which effects require continued observation after a technical restart.

Case-analysis method
StageAction and prerequisiteEvidence of usable progress
Protect essential usersProvide a feasible interim function while restoration proceeds.Coverage and actual receipt.
Restore prerequisitesRecover access, inputs, energy, information and competent personnel.Verified availability for the next task.
Restore the processRepair and operate the affected function within its relevant constraints.Technical tests matched to the failure mechanism.
Verify performanceMeasure the delivered outcome and remaining exposure.A predeclared verification record.
Authorize and communicateRecord who can declare the relevant return condition.Clear status, limitations and notification.
Follow upMonitor persistent effects and resolve causal and monitoring gaps.A review record and tracked corrective actions.

Section readings [G09]

PART VII

Restoration and recovery architecture

SECTION 22

Recovery provider capability

Technical contributors should be qualified for the function they perform. Statistical analysis, community engagement, legal interpretation and service delivery require different capabilities. Assess evidence of relevant work, independence, accessibility and the ability to explain limitations. Familiarity with a framework is insufficient to establish competence across all public responsibilities. A review process should disclose material interests and allocate tasks so that evidence producers do not control every stage of evaluation. Document how disagreements affect the final analytical conclusion. [G11] Specify the expertise needed for one decision and identify a gap that external review must address.

Capability assessment must be specific to the task, place and stress conditions. A training certificate cannot demonstrate that a team can mobilize and deliver the required function. Inspect competence, safety, compatibility, relevant experience and actual availability. Define the verification method and limits of recognition. This teaching library does not establish a c-ECO provider certification scheme or substitute for professional or regulatory requirements.

Case-analysis method
CapabilityVerification
Technical capabilityEvidence relevant to the specific task, process and failure mechanism.
MobilizationA demonstrated route, team, equipment and useful arrival time.
CompatibilityProof that resources can work with the installation, data and local constraints.
Safety and responsibilitiesRelevant professional duties, safe work and accountable supervision.
VerificationPerformance tests, records and independent review proportionate to the task.
ContinuitySubstitutes and supplies under simultaneous demand or extended interruption.

Section readings [G11]

SECTION 23

Recovery sequencing and time constraints

Recovery sequencing should protect essential functions while preserving lawful review. First establish the safety and integrity of the operating environment; then restore authoritative records, decision channels and minimum service; finally verify corrections and durable improvements. Some steps can proceed in parallel, but a dependent service should not be declared restored before its evidence base is trustworthy. Publish practical access information appropriate to affected communities and keep a record of unresolved cases requiring later remediation. [G15] Distinguish temporary continuity from full correction of the original failure mechanism.

A recovery time objective is a decision criterion to test against real capacity. Distinguish mobilization, work, verification and decision time, and identify dependencies between tasks. Shared resources can prevent apparently parallel activities from proceeding together. Repeating the sequence with unavailable access, a specialist or a verification service reveals where a target relies on an untested assumption.

Case-analysis method
Sequencing itemCase requirement
Task and functionDefine the outcome, prerequisites and critical users.
Time componentsSeparate mobilization, execution, verification and decision time.
Shared resourcesIdentify people, equipment, access and systems needed by more than one task.
Parallel workDemonstrate that tasks can proceed together without competing for the same bottleneck.
Completion conditionSpecify the observation that permits the next task or return of the function.
SensitivityRepeat with unavailable resources or longer lead times to expose the critical path.

Section readings [G15]

SECTION 24

Equipment, inputs and replenishment

An inventory of governance resources includes people, records, agreements, service channels and review capacity. Counted resources become useful only when availability, competence and access can be demonstrated under the scenario. A list of trained staff may overstate capacity if the same people occupy several critical roles. Shared software or common premises can create hidden concentration. Record deployment conditions, accessibility and the time needed to become operational. Regular exercises should test the inventory rather than merely confirm its existence. [G03] Identify resources that appear independent in the inventory but share a common point of failure.

Inventory analysis connects each item to a protected function. Use condition, compatibility, accessibility and consumption under stress rather than a nominal stock count alone. Replenishment time must include procurement, transport, installation and verification where relevant. A substitute that depends on the same supplier or platform may disappear in the same event. Keep the last inspection date and the evidence supporting usable availability.

Case-analysis method
Inventory fieldVerification
SpecificationIdentity, quantity, condition, compatibility and installation requirements.
AvailabilityLocation, access rights, expiry where relevant and verification date.
Stress consumptionUseful stock under the conditions studied, including losses and surge demand.
ReplenishmentSupplier, lead time, transport constraints and alternatives.
Common dependenceOther stocks or substitutes that share a supplier, access route, platform or energy source.
TestEvidence from inspection, deployment or a representative mobilization exercise.

Section readings [G03]

SECTION 25

Mutual aid and cooperation arrangements

Mutual assistance requires agreed interfaces before a crisis. Receiving institutions need to know how to request support, verify authority, protect personal data and transfer responsibility back when ordinary capacity returns. Resources offered by neighbors may be unavailable during a regional disturbance. Examine geographic correlation and whether the assisting body faces its own service duties. Evaluation should include the receiving community's experience and whether temporary arrangements preserve complaint and review routes. Cooperation works through tested commitments and compatible procedures. [G02] Test an assistance request that cannot be fulfilled and identify the next feasible option.

Cooperation contributes to recovery when its scope, activation, resources and practical availability are demonstrated. Record who requests support, who authorizes it, the useful arrival time, responsibility for the work and conditions of return. Consider simultaneous demand across participants. A reference to an organization or network in the literature does not imply that c-ECO or a case partner has joined it or secured a deployment commitment.

Case-analysis method
Agreement elementQuestion
ActivationWho can request and authorize support, and on what documented basis?
ResourceWhat can actually be supplied, at what capacity and for how long?
DeliveryWhich access, transport, compatibility, information and safety conditions apply?
SimultaneityWhat happens when several participants need the resource at the same time?
ResponsibilityWhich actor controls the task and its records, verification and constraints?
ReviewHow are performance, remaining gaps and revised arrangements recorded?

Section readings [G02]

PART VIII

Research and source library

SECTION 26

Source classification and evidence quality

Classify evidence by what it establishes. A law identifies an obligation, a service record documents administrative activity, a survey describes reported experience and an investigation reconstructs a particular failure. None automatically proves the causal effect of a reform. Distinguish source institution from evidentiary role and assess relevance, timeliness, independence and methodological transparency. Conflicting sources should prompt an explanation of definitions and scope before one is dismissed. The source inventory should make these differences visible to readers. [G07] For one claim, identify which source provides observation and which supplies interpretation.

Source classes organize origin and function; they do not form an automatic hierarchy of evidential strength. An official statistic, an operational record and a causal study answer different questions. Classify the product, not only the organization. Detect shared data origins so that a dashboard, article and secondary report based on one observation are not counted as three independent confirmations.

Case-analysis method
Source classContributionQuality criterion
A · Institutional / officialOfficial statistics, instruments, technical guidance and investigation records.Mandate, method, version, scope and actual applicability.
B · Operational / technicalMeasurements, process records, assets, inventories and delivered performance.Traceability, coverage, quality controls and usable access.
C · Academic / independentResearch designs, mechanism studies, models and independent observations.Methods, inference, reproducibility and fit to the question.

Section readings [G07; C04; C05]

SECTION 27

Institutional, regulatory and technical sources

Intergovernmental and regulatory sources provide mandates, policy commitments and institutional indicators. Their strength is often coverage and comparability, but administrative definitions can vary and reporting incentives may affect completeness. Read the methodological notes before comparing jurisdictions. A compliance declaration is different from an independently verified outcome, and an international principle is different from an enforceable local requirement. Preserve the date, version and relevant jurisdiction so that later policy changes do not silently alter the interpretation of historical evidence. [G13] Check whether two jurisdictions count the same administrative event in the same way.

Institutional sources should be selected by product, method and scale. Record whether the source defines a requirement, observes a condition, reports an investigation or synthesizes a literature. A current portal may contain several editions and methods; cite the actual version used. Public access does not establish accuracy for a different question, and a restricted source can still be used only under its authorized conditions.

Institutional and technical source register
IDProduct / documentWhy it matters
[G13]OECD Principles on Water GovernancePublic-governance assessment reference; no institutional affiliation implied.
[G14]Sendai Framework for Disaster Risk Reduction 2015–2030Risk understanding, governance, investment and preparedness.
[G15]Catastrophic Disasters: Enhanced Leadership, Capabilities, and Accountability Controls Will Improve the Effectiveness of the Nation's Preparedness, Response, and Recovery SystemKatrina-related findings on authority, capacity and accountability.
[G16]Management Weaknesses Delayed Response to Flint Water CrisisEvidence escalation and oversight boundaries.
[G17]Phase 2 ReportRegulation, organizational responsibility and ignored evidence in building safety.
[G18]Columbia Accident Investigation Board Report, Volume IOrganizational conditions and technical evidence in an irreversible loss.
[G19]COVID-19: Make it the Last PandemicInternational warning, preparedness and coordination failures.
[G20]The February 2021 Cold Weather Outages in Texas and the South Central United StatesCross-sector coordination and persistent preparedness gaps.

Section readings [G13]

SECTION 28

Operational observations and monitoring products

Operational evidence includes case-management logs, maintenance authorizations, procurement records and service interruptions. It often provides the timing needed to reconstruct a decision chain. It also reflects how the institution organizes its own work, which can omit informal barriers or unsuccessful attempts to obtain service. Pair administrative records with accessible user evidence and document missingness. Data minimization matters: analysis should use the information necessary for the question while preserving privacy, lawful access and correction rights. [G11] Look for a population that does not appear in the system because it could not enter it.

Operational observations should show what the system delivered, not merely that an asset was declared available. Inspect the acquisition process, sensor or reporting changes, gaps, coverage and quality controls. Compare records with independent observations where feasible. Aggregated performance, a status dashboard and user experience can diverge because they concern different units, locations, periods or definitions of availability.

Observation products to obtain for the case
ObservationUnitInterpretationProvenance record
Unassigned critical decisionscountRecord the decision, lawful authority and deadline; distinguish absent ownership from delayed assignmentRecord acquisition, coverage, timestamp, reference, quality controls and the responsible custodian.
Median decision timedaysTimestamp receipt and final reasoned decision by case classRecord acquisition, coverage, timestamp, reference, quality controls and the responsible custodian.
Upper-tail decision timedays, 90th percentileUse comparable case cohorts; identify censored unresolved casesRecord acquisition, coverage, timestamp, reference, quality controls and the responsible custodian.
Backlog agedaysTrack oldest and distribution, not only total countRecord acquisition, coverage, timestamp, reference, quality controls and the responsible custodian.
New-to-resolved case ratioratio per periodDefine intake and closure consistentlyRecord acquisition, coverage, timestamp, reference, quality controls and the responsible custodian.
Mandate conflicts unresolvedcountRegister the conflicting provisions and competent resolution routeRecord acquisition, coverage, timestamp, reference, quality controls and the responsible custodian.
Staff vacancy rate% authorized postsSeparate essential specialties from general staffingRecord acquisition, coverage, timestamp, reference, quality controls and the responsible custodian.
Specialist turnover% per yearFollow role-specific losses and replacement readinessRecord acquisition, coverage, timestamp, reference, quality controls and the responsible custodian.
Documented decision rationale coverage% sampled decisionsRequire reasons linked to evidence and authorityRecord acquisition, coverage, timestamp, reference, quality controls and the responsible custodian.
Traceable evidence coverage% sampled material claimsCheck source, version and access permissionsRecord acquisition, coverage, timestamp, reference, quality controls and the responsible custodian.
Public information response timedaysApply the relevant legal rules and exclusionsRecord acquisition, coverage, timestamp, reference, quality controls and the responsible custodian.
Accessible consultation coverage% affected groups reachedAssess language, disability and digital access explicitlyRecord acquisition, coverage, timestamp, reference, quality controls and the responsible custodian.

Section readings [G11]

SECTION 29

Academic research and independent evidence

Academic and community evidence can expose mechanisms absent from formal reporting. Peer-reviewed research helps assess theoretical and causal claims; local organizations may reveal inaccessible channels or implementation gaps. Neither institutional prestige nor proximity to a problem is sufficient proof of every claim. Assess methods, selection, conflicts, interpretation and the relationship between evidence and conclusion. Disagreement can identify an important boundary condition rather than a source to be removed. Participation should allow affected groups to challenge how their experience is represented. [G09] Compare one administrative explanation with an independently collected account of the same process.

Read the research design before transferring a conclusion. Identify the question, unit of analysis, method, comparison, result, limitations and conditions that matter for the case. Foundational concepts, empirical studies, critical replications and technical syntheses serve different functions. A literature-supported mechanism may justify a hypothesis without validating a local threshold, forecasting performance or a complete TFP application.

Academic reading map: mechanisms and methods
IDResearch workContribution and limit
[G01]A general framework for analyzing sustainability of social-ecological systemsDiagnostic institutional variables; avoid treating one organizational form as a universal solution.
[G02]Collaborative Governance in Theory and PracticeStarting conditions, participation and trust in cross-boundary collaboration.
[G03]An Integrative Framework for Collaborative GovernanceJoint capacity, principled engagement and collaborative dynamics.
[G04]Adaptive Governance of Social-Ecological SystemsLearning and institutional adaptation during abrupt change.
[G05]A conceptual framework for analysing adaptive capacity and multi-level learning processes in resource governance regimesDistinguishes adjustment of actions from reconsideration of assumptions and institutional arrangements.
[G06]Scale and Cross-Scale Dynamics: Governance and Information in a Multilevel WorldJurisdictional, temporal and knowledge-scale mismatches.
[G07]Knowledge systems for sustainable developmentSalience, credibility and legitimacy in science-policy interfaces.
[G08]Adaptive Water Governance: Assessing the Institutional Prescriptions of Adaptive (Co-)Management from a Governance Perspective and Defining a Research AgendaTests institutional prescriptions rather than assuming decentralization always works.
[G09]Varieties of Participation in Complex GovernanceWho participates, how they communicate and their relation to public authority.
[G10]The struggle to govern the commonsInformation, rule compliance, conflict resolution and institutional adaptation.
[G11]Analysing and Assessing Accountability: A Conceptual FrameworkAccountability as a relationship of explanation, questioning and consequences.
[G12]“Opening Up” and “Closing Down”: Power, Participation, and Pluralism in the Social Appraisal of TechnologyHow appraisal can expose alternatives or prematurely narrow choice.
[C01]Identifying, understanding, and analyzing critical infrastructure interdependenciesDistinguishes physical, cyber, geographic and logical dependencies; use the categories to formulate a case-specific dependency hypothesis.
[C02]Understanding Compound, Interconnected, Interacting, and Cascading Risks: A Holistic FrameworkProvides distinctions for examining interacting risks and propagation; a plausible pathway still needs evidence in the case.
[C03]Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity indexMethodological reference for sensitivity analysis; assumptions about independence and the model structure must accompany the chosen estimator.
[C04]The FAIR Guiding Principles for scientific data management and stewardshipGuides metadata and reuse. Accessible data may still have legitimate authorization and protection requirements.

Section readings [G09]

PART IX

Evidence matrices and historical intelligence

SECTION 30

Source–variable correspondence

A source-to-variable map should show how an observation supports an indicator. A case log can estimate decision time only if timestamps have stable meanings; an annual report cannot provide hourly warning latency. Document transformation rules, exclusions and uncertainty. Derived scores require transparent normalization and weighting, especially when combining service performance with procedural measures. Preserve underlying variables so that an improved average does not conceal growing inequality or a severe deterioration in a critical function. [G12] Recalculate one indicator from a small auditable sample and explain every exclusion.

The source–variable matrix exposes the path from an observation to an analytical representation. Preserve the raw unit, time, location, method, transformation and uncertainty. Multiple derived variables may share one observation and therefore share its limitations. Record the code or reproducible procedure, authorized access and version. A score should remain inspectable through its originating evidence rather than replacing that evidence.

Source–variable design matrix
ObservationUnitSource requirementCandidate analytical questionTransformation and limit
Unassigned critical decisionscountRecord the decision, lawful authority and deadline; distinguish absent ownership from delayed assignmentP / stateVerify whether the observation supports this analytical use; preserve the raw record and transformation.
Median decision timedaysTimestamp receipt and final reasoned decision by case classP and ΔV / trajectoryVerify whether the observation supports this analytical use; preserve the raw record and transformation.
Upper-tail decision timedays, 90th percentileUse comparable case cohorts; identify censored unresolved casesσ / evidence qualityVerify whether the observation supports this analytical use; preserve the raw record and transformation.
Backlog agedaysTrack oldest and distribution, not only total countLr / usable resourcesVerify whether the observation supports this analytical use; preserve the raw record and transformation.
New-to-resolved case ratioratio per periodDefine intake and closure consistentlyP / stateVerify whether the observation supports this analytical use; preserve the raw record and transformation.
Mandate conflicts unresolvedcountRegister the conflicting provisions and competent resolution routeP and ΔV / trajectoryVerify whether the observation supports this analytical use; preserve the raw record and transformation.
Staff vacancy rate% authorized postsSeparate essential specialties from general staffingσ / evidence qualityVerify whether the observation supports this analytical use; preserve the raw record and transformation.
Specialist turnover% per yearFollow role-specific losses and replacement readinessLr / usable resourcesVerify whether the observation supports this analytical use; preserve the raw record and transformation.
Documented decision rationale coverage% sampled decisionsRequire reasons linked to evidence and authorityP / stateVerify whether the observation supports this analytical use; preserve the raw record and transformation.
Traceable evidence coverage% sampled material claimsCheck source, version and access permissionsP and ΔV / trajectoryVerify whether the observation supports this analytical use; preserve the raw record and transformation.
Public information response timedaysApply the relevant legal rules and exclusionsσ / evidence qualityVerify whether the observation supports this analytical use; preserve the raw record and transformation.
Accessible consultation coverage% affected groups reachedAssess language, disability and digital access explicitlyLr / usable resourcesVerify whether the observation supports this analytical use; preserve the raw record and transformation.

Section readings [G12; C04; C05]

SECTION 31

Source–risk correspondence

Mapping evidence to risks requires an explicit causal claim. A high appeal rate may indicate poor initial decisions, better access to challenge, or both. Use comparative timing, case characteristics and independent review to test alternatives. Avoid treating a single proxy as a direct measurement of capture, legitimacy or institutional resilience. Stronger inference combines sources with different failure modes and examines what evidence would contradict the proposed mechanism. The map should show where observations are direct, indirect or currently missing. [G01] Write one plausible competing explanation and the evidence that could distinguish it.

A source–risk matrix should cover the threat, the observed state, the mechanism and the consequences separately. Evidence that an event occurred does not alone show why a function failed or who was affected. Use a chronology and alternative explanations to test the chain. A citation becomes useful when the specific part of the claim it supports and its limits are visible.

Source–risk evidence matrix
RiskProposed mechanismEvidence chainInvestigation requirement
Unclear mandateSeveral agencies assume another owns the decisionThreat / state → mechanism → consequence.Specify the dated observation for each link and at least one alternative explanation.
Conflicting mandatesSafety, development and service goals lack an agreed reconciliation processThreat / state → mechanism → consequence.Specify the dated observation for each link and at least one alternative explanation.
Decision backlogDemand persistently exceeds processing capacityThreat / state → mechanism → consequence.Specify the dated observation for each link and at least one alternative explanation.
Evidence suppressionAdverse findings fail to enter the decision recordThreat / state → mechanism → consequence.Specify the dated observation for each link and at least one alternative explanation.
Regulatory captureRegulated interests dominate framing or enforcementThreat / state → mechanism → consequence.Specify the dated observation for each link and at least one alternative explanation.
Procurement lock-inEssential services depend on one difficult-to-replace contractorThreat / state → mechanism → consequence.Specify the dated observation for each link and at least one alternative explanation.
Emergency power overreachTemporary measures lack review and expiry safeguardsThreat / state → mechanism → consequence.Specify the dated observation for each link and at least one alternative explanation.
Administrative exclusionEligibility or documentation rules exclude affected residentsThreat / state → mechanism → consequence.Specify the dated observation for each link and at least one alternative explanation.
Jurisdictional fragmentationConsequences cross boundaries without coordinationThreat / state → mechanism → consequence.Specify the dated observation for each link and at least one alternative explanation.
Budget execution failureApproved resources cannot be lawfully mobilized when neededThreat / state → mechanism → consequence.Specify the dated observation for each link and at least one alternative explanation.

Section readings [G01]

SECTION 32

Monitoring gaps and research priorities

Monitoring gaps are part of the analysis, not an appendix of minor imperfections. Unrecorded informal decisions, inaccessible complaints and missing distributional information can systematically exclude the people most affected by failure. Prioritize gaps by their consequences for the decision rather than by ease of measurement. A temporary qualitative inquiry may be more useful than a highly precise metric collected from the wrong population. State how the decision remains robust, or does not, while the gap persists. [G07] Identify the missing observation most likely to change the recommended action.

Prioritize a gap by its consequence for the decision. The next observation may be a targeted measurement, an independent comparison, a capability test or a correction of incompatible definitions. More data of the same kind may not resolve structural uncertainty. Specify the question, required observation, responsible custodian, time of collection and condition under which the gap is considered sufficiently addressed.

Case-analysis method
Monitoring gapDecision consequenceInvestigation
Spatial coverageExposed locations, groups or assets are not represented.Targeted observations matched to exposure.
Temporal resolutionA change occurs faster than the collection interval.A sampling interval fitted to the process and useful decision time.
Missing periodA critical part of the trajectory is absent.Independent backup and transparent missing-data handling.
Changing methodA sensor, reference or reporting practice changes.Overlap, comparison and version metadata.
Unmeasured mechanismImportant inputs or consequences are not observed.A mechanism-specific investigation and appropriate measurement.
Unverified resourcesA listed capacity has not been mobilized.Inspection and a representative deployment test.
Incompatible definitionsDatasets describe different populations, units or conditions.A documented harmonization and retained original values.
Access restrictionEvidence cannot be inspected or reused under current conditions.An authorized access and review arrangement.
Unequal representationSome users or effects disappear in aggregates.Disaggregated observation and a suitable participatory protocol.
Post-event follow-upReturn of service masks persistent effects.A monitoring period appropriate to the mechanism and affected function.

Section readings [G07; C03]

SECTION 33

Dependency matrix and propagation tests

A governance dependency matrix should describe directional mechanisms, response delays and possible substitution. Public administration depends on electricity and communications while those services depend on permitting, coordination and oversight. Reciprocal dependence does not imply equal influence in both directions. Use a case-specific matrix and attach evidence to each important link. A dense network drawing alone does not establish which functions are critical; test the consequences of a disruption and the feasibility of maintaining minimum service through alternatives. [G06] Compare a physical dependency with a legal dependency and explain why their remedies differ.

Public trust is neither an unlimited reserve nor a direct measure of truth. Inconsistent explanations, unequal service delivery and uncorrected errors can weaken cooperation. Assess trust alongside independently observable service performance and the fairness of procedures; neither opinion surveys nor administrative outputs substitute for the other. [G02]

Rules often fit administrative boundaries better than ecological or infrastructure systems. Upstream decisions may affect downstream populations lacking a voice in the original jurisdiction. Cross-scale analysis should identify who experiences consequences, who holds authority and which agreements enable information exchange and dispute resolution. [G06]

Organizational learning has several depths. Correcting a form or staffing rota changes execution; revising the assumed causal model changes strategy; redistributing authority changes the institutional setting. A review that produces recommendations without owners, milestones and follow-up evidence may document learning without changing practice. [G05]

A dependency matrix should be directional and time-specific. Record the supplying function, receiving function, mechanism, useful delay, substitute and evidence. Test the destination when the origin becomes unavailable for different periods. Then remove a common prerequisite of the substitute. The resulting structure describes the case; it does not establish all connections in a global architecture or validate an edge weight.

Dependency matrix for case testing
DependencyMechanism and directionVerification or TFP inquiry
Water and sanitationService disruption changes administrative demand and health burdenCoordinate service evidence and public guidance
EnergyPower interruption disables offices and digital servicesTest continuity of essential decisions
HealthHealth alerts require timely intergovernmental actionDefine evidence and authority interfaces
Food systemsSupply disruption changes assistance prioritiesAlign eligibility and logistics information
FinanceLiquidity and execution rules constrain public responseDistinguish approved resources from deployable resources
InfrastructureAsset safety depends on licensing and maintenance oversightTrack ownership of safety decisions
Digital systemsIdentity, records and communications depend on shared platformsPreserve offline continuity and recoverable records
Land and urban systemsPlanning decisions create long-lived exposureEvaluate cumulative and distributional consequences
Scientific observationPolicy depends on timely interpretable evidenceDocument uncertainty and independent scrutiny
Strategic resilienceEmergency coordination can affect civil rights and essential servicesMaintain proportionality, oversight and civilian protection

For each relationship, add the measured delay, duration of tolerable interruption, substitute and observation supporting the directed edge. Repeat the test for short, intermediate and extended unavailability. A generic list of linked sectors is not an estimated network, and no edge weight is validated by inclusion in this table.

Section readings [G06; C01; C02]

SECTION 34

Documented cases, near misses and recovery

Historical cases support comparison when mechanisms and context are preserved. Flint illustrates oversight and evidence escalation; Grenfell requires attention to regulation and organizational responsibility; Katrina highlights coordination and capability. These cases should not be compressed into identical success or failure scores. Reconstruct the sequence from primary investigations, distinguish findings from later interpretation and identify what could reasonably have been known before the outcome. Comparative learning asks which mechanism may recur and which conditions make transfer inappropriate. [G16] [G17] Choose two cases with different hazards and compare one institutional mechanism without equating their impacts.

Historical analysis distinguishes observed loss, protective response, near miss and recovery. Several records can concern one event without becoming independent events. Preserve what the source actually investigated and avoid adding unsupported casualty, cost or restoration-time estimates. Compare cases by mechanism and evidence quality; the fact that one response was associated with an outcome does not alone establish a general causal effect.

Documented cases and comparative learning
Case / periodDocumented mechanism or study objectLearning and transfer questionSource
Hurricane Katrina, United States, 2005Ambiguous responsibilities and insufficient integrated capacity complicated responseTrace authority, resources and handoffs across levels[G15]
Flint water crisis, United States, 2014–2016Oversight weaknesses and delayed response to evidence prolonged the crisisCompare information custody with the authority and duty to act[G16]
Grenfell Tower fire, United Kingdom, 2017; inquiry 2024The inquiry examined systemic failures across construction, regulation and public bodiesReconstruct how warnings and responsibility were distributed[G17]
Space Shuttle Columbia, United States, 2003Technical damage and organizational conditions jointly contributed to the lossStudy how uncertain technical concerns entered management decisions[G18]
COVID-19 pandemic, global, 2020–2021 reviewPreparedness, international warning and coordinated action did not align sufficientlyCompare early information with available institutional response pathways[G19]
Texas and South Central U.S. cold-weather outages, 2021Power and gas dependencies interacted with preparedness gapsExamine implementation of earlier recommendations and cross-sector coordination[G20]

Section readings [G16; G17]

SECTION 35

Integrated review, transfer and learning portfolio

Cross-domain governance analysis asks how decisions in one function alter exposure or recovery elsewhere. Land-use approval can create long-lived flood exposure, while energy interruption can disable administrative channels. Keep responsibility and causation distinct: an actor may contribute to a dependency without controlling the entire system. A strong synthesis identifies the next authorized decision, evidence required, affected groups and unresolved disagreement. It also explains what would trigger reconsideration, so the analytical conclusion remains open to new evidence and changing conditions. [G14] End the case with a reasoned decision memo that includes alternatives and a review condition.

The integrated portfolio should allow a reviewer to move from the question to observations, transformations, mechanism tests, scenarios and proposed monitoring. Make the strongest competing explanation and the most consequential unresolved gap visible. Transfer requires checking mechanisms, exposure and recovery resources in the new setting. Formation, optional credentialing, submission permission and licensing remain distinct processes; no case or data contribution enters the SIL without an associated fellow and applicable review.

Case-analysis method
Review stepEvidence requirement
SpecifyState the function, claim, exposed group, location and period.
TraceIdentify original observations, shared origins and transformations.
HarmonizeCompare units, reference systems, sampling and versions.
ChallengeTest alternative explanations and seek counter-evidence.
Evaluate uncertaintyIdentify which assumptions change the conclusion or recommended action.
Test transferCheck equivalence of mechanisms, exposure and recovery resources in another setting.
Record and updatePreserve reasons, limits, responsibility and the next review condition.

Section readings [G14; C04; C05]

RESEARCH AND READING PATHS

Annotated scientific and technical bibliography

The section citations connect domain mechanisms, methods and cases to the underlying sources. Read each reference for its question, design, findings and limits. Technical guides, case investigations and scholarly articles do not provide interchangeable forms of evidence.

  1. G01 · Scholarly article

    Ostrom, E. (2009). A general framework for analyzing sustainability of social-ecological systems. Science 325, 419–422.

    Original publication / source ↗

    Diagnostic institutional variables; avoid treating one organizational form as a universal solution.

  2. G02 · Scholarly article

    Ansell, C.; Gash, A. (2008). Collaborative Governance in Theory and Practice. Journal of Public Administration Research and Theory 18, 543–571.

    Original publication / source ↗

    Starting conditions, participation and trust in cross-boundary collaboration.

  3. G03 · Scholarly article

    Emerson, K.; Nabatchi, T.; Balogh, S. (2012). An Integrative Framework for Collaborative Governance. Journal of Public Administration Research and Theory 22, 1–29.

    Original publication / source ↗

    Joint capacity, principled engagement and collaborative dynamics.

  4. G04 · Scholarly review

    Folke, C. et al. (2005). Adaptive Governance of Social-Ecological Systems. Annual Review of Environment and Resources 30, 441–473.

    Original publication / source ↗

    Learning and institutional adaptation during abrupt change.

  5. G05 · Scholarly article

    Pahl-Wostl, C. (2009). A conceptual framework for analysing adaptive capacity and multi-level learning processes in resource governance regimes. Global Environmental Change 19, 354–365.

    Original publication / source ↗

    Distinguishes adjustment of actions from reconsideration of assumptions and institutional arrangements.

  6. G06 · Scholarly article

    Cash, D. W. et al. (2006). Scale and Cross-Scale Dynamics: Governance and Information in a Multilevel World. Ecology and Society 11(2), 8.

    Original publication / source ↗

    Jurisdictional, temporal and knowledge-scale mismatches.

  7. G07 · Scholarly article

    Cash, D. W. et al. (2003). Knowledge systems for sustainable development. PNAS 100, 8086–8091.

    Original publication / source ↗

    Salience, credibility and legitimacy in science-policy interfaces.

  8. G08 · Scholarly article

    Huitema, D. et al. (2009). Adaptive Water Governance: Assessing the Institutional Prescriptions of Adaptive (Co-)Management from a Governance Perspective and Defining a Research Agenda. Ecology and Society 14(1), 26.

    Original publication / source ↗

    Tests institutional prescriptions rather than assuming decentralization always works.

  9. G09 · Scholarly article

    Fung, A. (2006). Varieties of Participation in Complex Governance. Public Administration Review 66, 66–75.

    Original publication / source ↗

    Who participates, how they communicate and their relation to public authority.

  10. G10 · Scholarly article

    Dietz, T.; Ostrom, E.; Stern, P. C. (2003). The struggle to govern the commons. Science 302, 1907–1912.

    Original publication / source ↗

    Information, rule compliance, conflict resolution and institutional adaptation.

  11. G11 · Scholarly article

    Bovens, M. (2007). Analysing and Assessing Accountability: A Conceptual Framework. European Law Journal 13, 447–468.

    Original publication / source ↗

    Accountability as a relationship of explanation, questioning and consequences.

  12. G12 · Scholarly article

    Stirling, A. (2008). “Opening Up” and “Closing Down”: Power, Participation, and Pluralism in the Social Appraisal of Technology. Science, Technology, & Human Values 33, 262–294.

    Original publication / source ↗

    How appraisal can expose alternatives or prematurely narrow choice.

  13. G13 · Official guidance

    OECD (2015). OECD Principles on Water Governance. OECD governance principles.

    Original publication / source ↗

    Public-governance assessment reference; no institutional affiliation implied.

  14. G14 · Official framework

    UNDRR (2015). Sendai Framework for Disaster Risk Reduction 2015–2030. United Nations framework.

    Original publication / source ↗

    Risk understanding, governance, investment and preparedness.

  15. G15 · Official investigation

    U.S. GAO (2006). Catastrophic Disasters: Enhanced Leadership, Capabilities, and Accountability Controls Will Improve the Effectiveness of the Nation's Preparedness, Response, and Recovery System. GAO-06-618.

    Original publication / source ↗

    Katrina-related findings on authority, capacity and accountability.

  16. G16 · Official investigation

    U.S. EPA Office of Inspector General (2018). Management Weaknesses Delayed Response to Flint Water Crisis. Report 18-P-0221.

    Original publication / source ↗

    Evidence escalation and oversight boundaries.

  17. G17 · Official inquiry

    Grenfell Tower Inquiry (2024). Phase 2 Report. Public inquiry.

    Original publication / source ↗

    Regulation, organizational responsibility and ignored evidence in building safety.

  18. G18 · Official investigation

    Columbia Accident Investigation Board (2003). Columbia Accident Investigation Board Report, Volume I. NASA Technical Reports Server.

    Original publication / source ↗

    Organizational conditions and technical evidence in an irreversible loss.

  19. G19 · Independent commissioned review

    Independent Panel for Pandemic Preparedness and Response (2021). COVID-19: Make it the Last Pandemic. Independent panel report.

    Original publication / source ↗

    International warning, preparedness and coordination failures.

  20. G20 · Official investigation

    FERC; NERC; Regional Entity Staff (2021). The February 2021 Cold Weather Outages in Texas and the South Central United States. Joint staff report.

    Original publication / source ↗

    Cross-sector coordination and persistent preparedness gaps.

  21. C01 · peer-reviewed

    Rinaldi, S. M.; Peerenboom, J. P.; Kelly, T. K. (2001). Identifying, understanding, and analyzing critical infrastructure interdependencies. IEEE Control Systems Magazine, 21(6), 11–25.

    Original publication / source ↗

    Distinguishes physical, cyber, geographic and logical dependencies; use the categories to formulate a case-specific dependency hypothesis.

  22. C02 · peer-reviewed

    Pescaroli, G.; Alexander, D. (2018). Understanding Compound, Interconnected, Interacting, and Cascading Risks: A Holistic Framework. Risk Analysis, 38, 2245–2257.

    Original publication / source ↗

    Provides distinctions for examining interacting risks and propagation; a plausible pathway still needs evidence in the case.

  23. C03 · peer-reviewed

    Saltelli, A. et al. (2010). Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index. Computer Physics Communications, 181, 259–270.

    Original publication / source ↗

    Methodological reference for sensitivity analysis; assumptions about independence and the model structure must accompany the chosen estimator.

  24. C04 · peer-reviewed

    Wilkinson, M. D. et al. (2016). The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data, 3, 160018.

    Original publication / source ↗

    Guides metadata and reuse. Accessible data may still have legitimate authorization and protection requirements.

  25. C05 · standard

    W3C (2013). PROV-DM: The PROV Data Model. W3C Recommendation, 30 April 2013.

    Original publication / source ↗

    Represents provenance through entities, activities and agents; useful for connecting a result to its transformations and responsible contributors.

  26. C06 · technical guide

    JCGM (2008). Evaluation of measurement data — Supplement 1 to the GUM — Propagation of distributions using a Monte Carlo method. JCGM 101:2008.

    Original publication / source ↗

    A methodological basis for propagating input distributions through a specified model, rather than treating simulated frequency as an observed event probability.

External sources are cited for research and learning. Their inclusion implies no partnership, certification or institutional endorsement.