00000nam 2200000za 4500 9.852936 CaOODSP 20221107154714 cr ||||||||||| 180306s2017 onc fo f000 0 eng d CaOODSP eng n-cn--- D69-50/2017E-PDF Restructuring structured analytic techniques in intelligence [electronic resource] / Welton Chang ... [et al.]. [Toronto] : Defence Research and Development Canada, Toronto Research Centre, c2017. 1 v. External literature (P) ; DRDC-RDDC-2017-P113 Cover title. Published in: Intelligence and National Security, 2017. Includes bibliographic references. Structured analytic techniques (SATs) are intended to improve intelligence analysis by checking the two canonical sources of error: systematic biases and random noise. Although both goals are achievable, no one knows how close the current generation of SATs comes to achieving either of them. We identify two root problems: (1) SATs treat bipolar biases as unipolar. As a result, we lack metrics for gauging possible over-shooting—and have no way of knowing when SATs that focus on suppressing one bias (e.g., overconfidence) are triggering the opposing bias (e.g., under-confidence); (2) SATs tacitly assume that problem decomposition (e.g., breaking reasoning into rows and columns of matrices corresponding to hypotheses and evidence) is a sound means of reducing noise in assessments. But no one has ever actually tested whether decomposition is adding or subtracting noise from the analytic process—and there are good reasons for suspecting that decomposition will, on balance, degrade the reliability of analytic judgment. The central shortcoming is that SATs have not been subject to sustained scientific of the sort that could reveal when they are helping or harming the cause of delivering accurate assessments of the world to the policy community gccst Security intelligence gccst Research Chang, Welton. Defence R&D Canada. Toronto Research Centre. External literature (P) (Defence R&D Canada) DRDC-RDDC-2017-P113 (CaOODSP)9.854437 PDF 346 KB https://publications.gc.ca/collections/collection_2018/rddc-drdc/D69-50-2017-eng.pdf