Deep Uncertainty


Lecture 24

November 13, 2023

  Activating project at `~/Teaching/BEE4750/fall2023/slides`
    Updating registry at `~/.julia/registries/General.toml`
   Installed HiGHS_jll ──────────── v1.11.0+1
   Installed GlobalSensitivity ──── v2.7.0
   Installed Bessels ────────────── v0.2.8
   Installed DSP ────────────────── v0.8.4
   Installed DelayEmbeddings ────── v2.9.0
   Installed TaylorSeries ───────── v0.18.5
   Installed LineSearches ───────── v7.4.0
   Installed StateSpaceSets ─────── v2.4.0
   Installed MathOptInterface ───── v1.41.0
   Installed WilliamsonTransforms ─ v0.1.6
   Installed Neighborhood ───────── v0.2.4
   Installed HiGHS ──────────────── v1.18.0
   Installed JuMP ───────────────── v1.26.0
   Installed ComplexityMeasures ─── v3.8.1
   Installed Copulas ────────────── v0.1.29
   Installed Wavelets ───────────── v0.10.1
    Updating `~/Teaching/BEE4750/fall2023/slides/Project.toml`
  [27a7e980] + Animations v0.4.2
  [336ed68f] + CSV v0.10.15
  [a93c6f00] + DataFrames v1.7.0
  [31c24e10] + Distributions v0.25.120
  [af5da776] + GlobalSensitivity v2.7.0
  [bd48cda9] + GraphRecipes v0.5.14
  [87dc4568] + HiGHS v1.18.0
  [7073ff75] + IJulia v1.28.1
  [4076af6c] + JuMP v1.26.0
  [b964fa9f] + LaTeXStrings v1.4.0
  [23fbe1c1] + Latexify v0.16.8
  [1862ce21] + MarkdownTables v1.1.0
  [442fdcdd] + Measures v0.3.2
  [bcdb8e00] + Metaheuristics v3.4.0
  [429524aa] + Optim v1.12.0
  [91a5bcdd] + Plots v1.40.13
  [08abe8d2] + PrettyTables v2.4.0
  [f2b01f46] + Roots v2.2.7
  [f3b207a7] + StatsPlots v0.15.7
  [fdbf4ff8] + XLSX v0.10.4
    Updating `~/Teaching/BEE4750/fall2023/slides/Manifest.toml`
  [47edcb42] + ADTypes v1.14.0
  [621f4979] + AbstractFFTs v1.5.0
  [1520ce14] + AbstractTrees v0.4.5
  [7d9f7c33] + Accessors v0.1.42
  [79e6a3ab] + Adapt v4.3.0
  [66dad0bd] + AliasTables v1.1.3
  [27a7e980] + Animations v0.4.2
  [dce04be8] + ArgCheck v2.5.0
  [ec485272] + ArnoldiMethod v0.4.0
  [7d9fca2a] + Arpack v0.5.4
  [4fba245c] + ArrayInterface v7.19.0
  [13072b0f] + AxisAlgorithms v1.1.0
  [198e06fe] + BangBang v0.4.4
  [9718e550] + Baselet v0.1.1
  [6e4b80f9] + BenchmarkTools v1.6.0
  [0e736298] + Bessels v0.2.8
  [d1d4a3ce] + BitFlags v0.1.9
  [336ed68f] + CSV v0.10.15
  [d360d2e6] + ChainRulesCore v1.25.1
  [aaaa29a8] + Clustering v0.15.8
  [523fee87] + CodecBzip2 v0.8.5
  [6309b1aa] + CodecInflate64 v0.1.3
  [944b1d66] + CodecZlib v0.7.8
  [35d6a980] + ColorSchemes v3.29.0
 [3da002f7] + ColorTypes v0.11.5
 [c3611d14] + ColorVectorSpace v0.10.0
  [5ae59095] + Colors v0.13.1
  [861a8166] + Combinatorics v1.0.3
  [38540f10] + CommonSolve v0.2.4
  [bbf7d656] + CommonSubexpressions v0.3.1
  [34da2185] + Compat v4.16.0
  [ab4b797d] + ComplexityMeasures v3.8.1
  [a33af91c] + CompositionsBase v0.1.2
  [2569d6c7] + ConcreteStructs v0.2.3
  [f0e56b4a] + ConcurrentUtilities v2.5.0
  [8f4d0f93] + Conda v1.10.2
  [187b0558] + ConstructionBase v1.6.0
  [d38c429a] + Contour v0.6.3
  [ae264745] + Copulas v0.1.29
  [a8cc5b0e] + Crayons v4.1.1
  [717857b8] + DSP v0.8.4
  [9a962f9c] + DataAPI v1.16.0
  [a93c6f00] + DataFrames v1.7.0
  [864edb3b] + DataStructures v0.18.22
  [e2d170a0] + DataValueInterfaces v1.0.0
  [244e2a9f] + DefineSingletons v0.1.2
  [5732040d] + DelayEmbeddings v2.9.0
  [8bb1440f] + DelimitedFiles v1.9.1
  [163ba53b] + DiffResults v1.1.0
  [b552c78f] + DiffRules v1.15.1
  [a0c0ee7d] + DifferentiationInterface v0.7.1
  [0b91fe84] + DisplayAs v0.1.6
  [b4f34e82] + Distances v0.10.12
  [31c24e10] + Distributions v0.25.120
  [ffbed154] + DocStringExtensions v0.9.5
  [4e289a0a] + EnumX v1.0.5
  [460bff9d] + ExceptionUnwrapping v0.1.11
  [e2ba6199] + ExprTools v0.1.10
  [411431e0] + Extents v0.1.6
  [8f5d6c58] + EzXML v1.2.1
  [c87230d0] + FFMPEG v0.4.2
  [7a1cc6ca] + FFTW v1.9.0
  [48062228] + FilePathsBase v0.9.24
  [1a297f60] + FillArrays v1.13.0
  [6a86dc24] + FiniteDiff v2.27.0
  [53c48c17] + FixedPointNumbers v0.8.5
  [1fa38f19] + Format v1.3.7
 [f6369f11] + ForwardDiff v0.10.38
  [46192b85] + GPUArraysCore v0.2.0
  [28b8d3ca] + GR v0.73.16
  [68eda718] + GeoFormatTypes v0.4.4
  [cf35fbd7] + GeoInterface v1.4.1
  [5c1252a2] + GeometryBasics v0.5.9
  [4d00f742] + GeometryTypes v0.8.5
  [af5da776] + GlobalSensitivity v2.7.0
  [bd48cda9] + GraphRecipes v0.5.14
  [86223c79] + Graphs v1.13.0
  [42e2da0e] + Grisu v1.0.2
  [19dc6840] + HCubature v1.7.0
  [cd3eb016] + HTTP v1.10.16
  [87dc4568] + HiGHS v1.18.0
  [34004b35] + HypergeometricFunctions v0.3.28
  [7073ff75] + IJulia v1.28.1
  [d25df0c9] + Inflate v0.1.5
  [22cec73e] + InitialValues v0.3.1
  [842dd82b] + InlineStrings v1.4.3
  [0c81fc1b] + InputBuffers v1.0.1
  [18e54dd8] + IntegerMathUtils v0.1.2
 [a98d9a8b] + Interpolations v0.15.1
  [3587e190] + InverseFunctions v0.1.17
  [41ab1584] + InvertedIndices v1.3.1
  [92d709cd] + IrrationalConstants v0.2.4
  [c8e1da08] + IterTools v1.10.0
  [82899510] + IteratorInterfaceExtensions v1.0.0
  [1019f520] + JLFzf v0.1.11
  [692b3bcd] + JLLWrappers v1.7.0
 [358108f5] + JMcDM v0.7.24
  [682c06a0] + JSON v0.21.4
  [0f8b85d8] + JSON3 v1.14.3
  [4076af6c] + JuMP v1.26.0
  [5ab0869b] + KernelDensity v0.6.9
  [b964fa9f] + LaTeXStrings v1.4.0
  [23fbe1c1] + Latexify v0.16.8
  [73f95e8e] + LatticeRules v0.0.1
  [d3d80556] + LineSearches v7.4.0
  [2ab3a3ac] + LogExpFunctions v0.3.29
  [e6f89c97] + LoggingExtras v1.1.0
  [1914dd2f] + MacroTools v0.5.16
  [1862ce21] + MarkdownTables v1.1.0
  [b8f27783] + MathOptInterface v1.41.0
  [739be429] + MbedTLS v1.1.9
  [442fdcdd] + Measures v0.3.2
  [bcdb8e00] + Metaheuristics v3.4.0
  [128add7d] + MicroCollections v0.2.0
  [e1d29d7a] + Missings v1.2.0
  [6f286f6a] + MultivariateStats v0.10.3
  [d8a4904e] + MutableArithmetics v1.6.4
  [37188c8d] + MvNormalCDF v0.3.2
  [d41bc354] + NLSolversBase v7.10.0
  [77ba4419] + NaNMath v1.1.3
  [b8a86587] + NearestNeighbors v0.4.21
  [645ca80c] + Neighborhood v0.2.4
  [46757867] + NetworkLayout v0.4.10
  [510215fc] + Observables v0.5.5
  [6fe1bfb0] + OffsetArrays v1.17.0
  [4d8831e6] + OpenSSL v1.5.0
  [429524aa] + Optim v1.12.0
  [bac558e1] + OrderedCollections v1.8.1
  [90014a1f] + PDMats v0.11.35
  [d96e819e] + Parameters v0.12.3
  [69de0a69] + Parsers v2.8.3
  [ccf2f8ad] + PlotThemes v3.3.0
  [995b91a9] + PlotUtils v1.4.3
  [91a5bcdd] + Plots v1.40.13
  [f27b6e38] + Polynomials v4.0.19
  [2dfb63ee] + PooledArrays v1.4.3
  [85a6dd25] + PositiveFactorizations v0.2.4
 [aea7be01] + PrecompileTools v1.2.1
  [21216c6a] + Preferences v1.4.3
  [08abe8d2] + PrettyTables v2.4.0
  [27ebfcd6] + Primes v0.5.7
  [43287f4e] + PtrArrays v1.3.0
  [1fd47b50] + QuadGK v2.11.2
  [8a4e6c94] + QuasiMonteCarlo v0.3.3
  [c84ed2f1] + Ratios v0.4.5
  [3cdcf5f2] + RecipesBase v1.3.4
  [01d81517] + RecipesPipeline v0.6.12
  [731186ca] + RecursiveArrayTools v3.33.0
  [189a3867] + Reexport v1.2.2
  [42d2dcc6] + Referenceables v0.1.3
  [05181044] + RelocatableFolders v1.0.1
  [ae029012] + Requires v1.3.1
  [79098fc4] + Rmath v0.8.0
  [f2b01f46] + Roots v2.2.7
  [7e49a35a] + RuntimeGeneratedFunctions v0.5.15
  [6c6a2e73] + Scratch v1.2.1
  [eb7571c6] + SearchSpaces v0.2.0
  [91c51154] + SentinelArrays v1.4.8
  [efcf1570] + Setfield v1.1.2
  [992d4aef] + Showoff v1.0.3
  [777ac1f9] + SimpleBufferStream v1.2.0
  [699a6c99] + SimpleTraits v0.9.4
  [66db9d55] + SnoopPrecompile v1.0.3
  [ed01d8cd] + Sobol v1.5.0
  [b85f4697] + SoftGlobalScope v1.1.0
  [a2af1166] + SortingAlgorithms v1.2.1
  [276daf66] + SpecialFunctions v2.5.1
  [171d559e] + SplittablesBase v0.1.15
  [860ef19b] + StableRNGs v1.0.3
  [40b095a5] + StateSpaceSets v2.4.0
  [90137ffa] + StaticArrays v1.9.13
  [1e83bf80] + StaticArraysCore v1.4.3
  [82ae8749] + StatsAPI v1.7.1
  [2913bbd2] + StatsBase v0.34.5
  [4c63d2b9] + StatsFuns v1.5.0
  [f3b207a7] + StatsPlots v0.15.7
  [892a3eda] + StringManipulation v0.4.1
  [856f2bd8] + StructTypes v1.11.0
  [2efcf032] + SymbolicIndexingInterface v0.3.40
  [ab02a1b2] + TableOperations v1.2.0
  [3783bdb8] + TableTraits v1.0.1
  [bd369af6] + Tables v1.12.1
 [6aa5eb33] + TaylorSeries v0.18.5
  [62fd8b95] + TensorCore v0.1.1
  [ac1d9e8a] + ThreadsX v0.1.12
  [3bb67fe8] + TranscodingStreams v0.11.3
  [28d57a85] + Transducers v0.4.84
  [592b5752] + Trapz v2.0.3
  [5c2747f8] + URIs v1.5.2
  [3a884ed6] + UnPack v1.0.2
  [1cfade01] + UnicodeFun v0.4.1
  [1986cc42] + Unitful v1.23.1
  [45397f5d] + UnitfulLatexify v1.7.0
  [41fe7b60] + Unzip v0.2.0
  [81def892] + VersionParsing v1.3.0
  [29a6e085] + Wavelets v0.10.1
  [ea10d353] + WeakRefStrings v1.4.2
  [cc8bc4a8] + Widgets v0.6.7
  [48feb556] + WilliamsonTransforms v0.1.6
  [efce3f68] + WoodburyMatrices v1.0.0
  [76eceee3] + WorkerUtilities v1.6.1
  [fdbf4ff8] + XLSX v0.10.4
  [c2297ded] + ZMQ v1.4.0
  [49080126] + ZipArchives v2.4.1
  [a5390f91] + ZipFile v0.10.1
 [68821587] + Arpack_jll v3.5.1+1
  [6e34b625] + Bzip2_jll v1.0.9+0
  [83423d85] + Cairo_jll v1.18.5+0
  [ee1fde0b] + Dbus_jll v1.16.2+0
  [5ae413db] + EarCut_jll v2.2.4+0
  [2702e6a9] + EpollShim_jll v0.0.20230411+1
  [2e619515] + Expat_jll v2.6.5+0
 [b22a6f82] + FFMPEG_jll v4.4.4+1
  [f5851436] + FFTW_jll v3.3.11+0
  [a3f928ae] + Fontconfig_jll v2.16.0+0
  [d7e528f0] + FreeType2_jll v2.13.4+0
  [559328eb] + FriBidi_jll v1.0.17+0
  [0656b61e] + GLFW_jll v3.4.0+2
  [d2c73de3] + GR_jll v0.73.16+0
  [78b55507] + Gettext_jll v0.21.0+0
  [7746bdde] + Glib_jll v2.84.0+0
  [3b182d85] + Graphite2_jll v1.3.15+0
  [2e76f6c2] + HarfBuzz_jll v8.5.1+0
  [8fd58aa0] + HiGHS_jll v1.11.0+1
  [1d5cc7b8] + IntelOpenMP_jll v2025.0.4+0
  [aacddb02] + JpegTurbo_jll v3.1.1+0
  [c1c5ebd0] + LAME_jll v3.100.2+0
  [88015f11] + LERC_jll v4.0.1+0
  [1d63c593] + LLVMOpenMP_jll v18.1.8+0
  [dd4b983a] + LZO_jll v2.10.3+0
  [e9f186c6] + Libffi_jll v3.4.7+0
  [7e76a0d4] + Libglvnd_jll v1.7.1+1
  [94ce4f54] + Libiconv_jll v1.18.0+0
  [4b2f31a3] + Libmount_jll v2.41.0+0
  [89763e89] + Libtiff_jll v4.7.1+0
  [38a345b3] + Libuuid_jll v2.41.0+0
  [856f044c] + MKL_jll v2025.0.1+1
  [e7412a2a] + Ogg_jll v1.3.5+1
  [458c3c95] + OpenSSL_jll v3.5.0+0
  [efe28fd5] + OpenSpecFun_jll v0.5.6+0
  [91d4177d] + Opus_jll v1.3.3+0
  [36c8627f] + Pango_jll v1.56.3+0
 [30392449] + Pixman_jll v0.44.2+0
  [c0090381] + Qt6Base_jll v6.8.2+1
  [629bc702] + Qt6Declarative_jll v6.8.2+1
  [ce943373] + Qt6ShaderTools_jll v6.8.2+1
  [e99dba38] + Qt6Wayland_jll v6.8.2+0
  [f50d1b31] + Rmath_jll v0.5.1+0
  [a44049a8] + Vulkan_Loader_jll v1.3.243+0
  [a2964d1f] + Wayland_jll v1.23.1+0
  [2381bf8a] + Wayland_protocols_jll v1.44.0+0
 [02c8fc9c] + XML2_jll v2.13.6+1
  [ffd25f8a] + XZ_jll v5.8.1+0
  [f67eecfb] + Xorg_libICE_jll v1.1.2+0
  [c834827a] + Xorg_libSM_jll v1.2.6+0
  [4f6342f7] + Xorg_libX11_jll v1.8.12+0
  [0c0b7dd1] + Xorg_libXau_jll v1.0.13+0
  [935fb764] + Xorg_libXcursor_jll v1.2.4+0
  [a3789734] + Xorg_libXdmcp_jll v1.1.6+0
  [1082639a] + Xorg_libXext_jll v1.3.7+0
  [d091e8ba] + Xorg_libXfixes_jll v6.0.1+0
  [a51aa0fd] + Xorg_libXi_jll v1.8.3+0
  [d1454406] + Xorg_libXinerama_jll v1.1.6+0
  [ec84b674] + Xorg_libXrandr_jll v1.5.5+0
  [ea2f1a96] + Xorg_libXrender_jll v0.9.12+0
  [c7cfdc94] + Xorg_libxcb_jll v1.17.1+0
  [cc61e674] + Xorg_libxkbfile_jll v1.1.3+0
  [e920d4aa] + Xorg_xcb_util_cursor_jll v0.1.4+0
  [12413925] + Xorg_xcb_util_image_jll v0.4.1+0
  [2def613f] + Xorg_xcb_util_jll v0.4.1+0
  [975044d2] + Xorg_xcb_util_keysyms_jll v0.4.1+0
  [0d47668e] + Xorg_xcb_util_renderutil_jll v0.3.10+0
  [c22f9ab0] + Xorg_xcb_util_wm_jll v0.4.2+0
  [35661453] + Xorg_xkbcomp_jll v1.4.7+0
  [33bec58e] + Xorg_xkeyboard_config_jll v2.44.0+0
  [c5fb5394] + Xorg_xtrans_jll v1.6.0+0
  [8f1865be] + ZeroMQ_jll v4.3.6+0
  [3161d3a3] + Zstd_jll v1.5.7+1
  [35ca27e7] + eudev_jll v3.2.14+0
  [214eeab7] + fzf_jll v0.61.1+0
  [a4ae2306] + libaom_jll v3.11.0+0
  [0ac62f75] + libass_jll v0.15.2+0
  [1183f4f0] + libdecor_jll v0.2.2+0
  [2db6ffa8] + libevdev_jll v1.13.4+0
  [f638f0a6] + libfdk_aac_jll v2.0.3+0
  [36db933b] + libinput_jll v1.28.1+0
  [b53b4c65] + libpng_jll v1.6.48+0
  [a9144af2] + libsodium_jll v1.0.21+0
  [f27f6e37] + libvorbis_jll v1.3.7+2
  [009596ad] + mtdev_jll v1.1.7+0
  [1317d2d5] + oneTBB_jll v2022.0.0+0
 [1270edf5] + x264_jll v2021.5.5+0
 [dfaa095f] + x265_jll v3.5.0+0
  [d8fb68d0] + xkbcommon_jll v1.8.1+0
  [0dad84c5] + ArgTools v1.1.1
  [56f22d72] + Artifacts
  [2a0f44e3] + Base64
  [ade2ca70] + Dates
  [8ba89e20] + Distributed
  [f43a241f] + Downloads v1.6.0
  [7b1f6079] + FileWatching
  [9fa8497b] + Future
  [b77e0a4c] + InteractiveUtils
  [4af54fe1] + LazyArtifacts
  [b27032c2] + LibCURL v0.6.4
  [76f85450] + LibGit2
  [8f399da3] + Libdl
  [37e2e46d] + LinearAlgebra
  [56ddb016] + Logging
  [d6f4376e] + Markdown
  [a63ad114] + Mmap
  [ca575930] + NetworkOptions v1.2.0
  [44cfe95a] + Pkg v1.10.0
  [de0858da] + Printf
  [9abbd945] + Profile
  [3fa0cd96] + REPL
  [9a3f8284] + Random
  [ea8e919c] + SHA v0.7.0
  [9e88b42a] + Serialization
  [1a1011a3] + SharedArrays
  [6462fe0b] + Sockets
  [2f01184e] + SparseArrays v1.10.0
  [10745b16] + Statistics v1.10.0
  [4607b0f0] + SuiteSparse
  [fa267f1f] + TOML v1.0.3
  [a4e569a6] + Tar v1.10.0
  [8dfed614] + Test
  [cf7118a7] + UUIDs
  [4ec0a83e] + Unicode
  [e66e0078] + CompilerSupportLibraries_jll v1.1.1+0
  [deac9b47] + LibCURL_jll v8.4.0+0
  [e37daf67] + LibGit2_jll v1.6.4+0
  [29816b5a] + LibSSH2_jll v1.11.0+1
  [c8ffd9c3] + MbedTLS_jll v2.28.2+1
  [14a3606d] + MozillaCACerts_jll v2023.1.10
  [4536629a] + OpenBLAS_jll v0.3.23+4
  [05823500] + OpenLibm_jll v0.8.1+2
  [efcefdf7] + PCRE2_jll v10.42.0+1
  [bea87d4a] + SuiteSparse_jll v7.2.1+1
  [83775a58] + Zlib_jll v1.2.13+1
  [8e850b90] + libblastrampoline_jll v5.8.0+1
  [8e850ede] + nghttp2_jll v1.52.0+1
  [3f19e933] + p7zip_jll v17.4.0+2
        Info Packages marked with  and  have new versions available. Those with  may be upgradable, but those with  are restricted by compatibility constraints from upgrading. To see why use `status --outdated -m`
Precompiling project...
InputBuffers
CodecInflate64
HiGHS_jll
MarkdownTables
Bessels
CodecBzip2
EzXML
Referenceables
TaylorSeries
HCubature
Animations
Widgets
ColorVectorSpace → SpecialFunctionsExt
MutableArithmetics
Neighborhood
MvNormalCDF
Transducers → TransducersReferenceablesExt
LineSearches
TaylorSeries → TaylorSeriesSAExt
GraphRecipes
ZipArchives
StateSpaceSets
StatsPlots
ThreadsX
TaylorSeries → TaylorSeriesRATExt
Optim
XLSX
WilliamsonTransforms
DelayEmbeddings
Polynomials
Polynomials → PolynomialsFFTWExt
Polynomials → PolynomialsChainRulesCoreExt
Polynomials → PolynomialsMutableArithmeticsExt
DSP
DSP → OffsetArraysExt
Wavelets
ComplexityMeasures
Copulas
MathOptInterface
Optim → OptimMOIExt
GlobalSensitivity
HiGHS
JuMP
  43 dependencies successfully precompiled in 43 seconds. 344 already precompiled.

Review and Questions

Simulation-Optimization

  • General approach to decision-making
  • Search for approximately “optimal” solutions by evaluating simulation model
  • Relies on heuristics (no guarantees about optimality)
  • Can be very sensitive to settings and details

Uncertainty and Optimization

Conceptual Assumptions of Optimization

Most optimization frameworks implicitly assume perfect specifications of:

  • Model structures/Parameter values
  • Decision alternatives
  • Probabilities/distributions

Reminder: Bifurcations

Bifurcation Diagram

Bifurcations occur at thresholds when the qualitative behavior of a system changes.

These thresholds are often associated with a stable state equilibrium transitioning to an unstable one.

Bifurcations and Misspecifications

A Relevant “Quote”

It ain’t what you don’t know that gets you into trouble. It’s what you know for sure that just ain’t so.

– Often attributed to Mark Twain (apocryphal)

How Do We Deal With Misspecification?

If we know something about probabilities: Monte Carlo or decision trees…

What if we don’t?

Deep Uncertainty

What Will CO2 Emissions Be In 2100?

How high do you think CO2 emissions be in 2100?

How High Will CO2 Emissions Be In 2100?

Poll Everywhere QR Code

Text: VSRIKRISH to 22333

URL: https://pollev.com/vsrikrish

See Results

Why Can’t We Agree?

Future CO2 emissions are dependent on multiple factors which are difficult to forecast:

  • economic output
  • technological change
  • policies and governance

Deep Uncertainty

When there is no consensus probability for an uncertainty, we refer to it as a deep uncertainty.

Another Relevant Quote!

Reports that say that something hasn’t happened are always interesting to me, because as we know, there are known knowns; there are things we know we know. We also know there are known unknowns; that is to say we know there are some things we do not know. But there are also unknown unknowns — the ones we don’t know we don’t know. And if one looks throughout the history of our country and other free countries, it is the latter category that tends to be the difficult ones.

– Donald Rumsfeld, 2002 (emphasis mine)

Translating the Word Salad

  • Known Knowns: Certainty
  • Known Unknowns: “Shallow” Uncertainty
  • Unknown Unknowns: “Deep” Uncertainty or ambiguity

Mixed Dice Shapes

The Ellsberg Paradox

Deep Uncertainty and Decision-Making

“Standard” decision theory assumes people have consistent preferences in the presence of uncertainty, which reflects:

  • maximizing some estimation of “losses”;
  • under an evaluation of the probabilities of various outcomes.

How do people make decisions under deep uncertainty?

The Two-Urn Game

Consider two urns, each containing 100 balls. Urn A has 50 red, 50 black balls, Urn B is an unknown mix.

You are offered the following bets: - Bet 1A: get \(\$1\) if red ball drawn from Urn A, else \(\$0\). - Bet 2A: get \(\$1\) if black ball drawn from Urn A, else \(\$0\). - Bet 1B: get \(\$1\) if red ball drawn from Urn B, else \(\$0\). - Bet 2B: get \(\$1\) if black ball drawn from Urn B, else \(\$0\).

Do You Prefer Bet 1A or 1B?

Poll Everywhere QR Code

Text: VSRIKRISH to 22333

URL: https://pollev.com/vsrikrish

See Results

The Ellsberg Paradox (Part 1)

Participants in this experiment were indifferent between 1A and 2A, which is consistent with expected utility theory.

But they also strictly preferred 1A to 1B and 2A to 2B, even though there was no reason to expect that Urn 2 was stacked against them.

Interpretation: People have an aversion to deep uncertainty.

The One-Urn Game

Now there is only one urn, with 30 red balls and 60 (black or yellow) balls (in unknown proportions)

  • Bet A: you win \(\$100\) if you draw a red ball;
  • Bet B: you win \(\$100\) if you draw a black ball;
  • Bet C: you win \(\$100\) if you draw a red or yellow ball;
  • Bet D: you win \(\$100\) if you draw a black or yellow ball;

Do You Prefer Bet A or B?

Poll Everywhere QR Code

Text: VSRIKRISH to 22333

URL: https://pollev.com/vsrikrish

See Results

The One-Urn Game

Now there is only one urn, with 30 red balls and 60 (black or yellow) balls (in unknown proportions)

  • Bet A: you win \(\$100\) if you draw a red ball;
  • Bet B: you win \(\$100\) if you draw a black ball;
  • Bet C: you win \(\$100\) if you draw a red or yellow ball;
  • Bet D: you win \(\$100\) if you draw a black or yellow ball;

Do You Prefer Bet C or D?

Poll Everywhere QR Code

Text: VSRIKRISH to 22333

URL: https://pollev.com/vsrikrish

See Results

The Ellsberg Paradox (Part 2)

Ellsberg found subjects prefer Bet A to Bet B. This is consistent with the Two Urn game: deep uncertainty aversion.

Subjects also preferred Bet D to Bet C. Why is this strange?

Key Takeaways

Key Takeaways

  • Misspecification is always a risk when developing a model, but can lead to major errors in the presence of nonlinear systems dynamics.
  • Systems can also exhibit deep uncertainties.
  • Deep uncertainty increases the risk of misspecification.
  • Deep uncertainty can complicate decision-making by leading to inconsistent decisions.

Upcoming Schedule

Upcoming Schedule

Wednesday/Friday: How do we analyze decisions when there is a risk of model misspecification or deep uncertainty?

After Thanksgiving: No class, will schedule 10-minute meetings with teams during class time the week after Thanksgiving to check on project progress. Attendance is required during your meeting.

Assessments

Lab 4: Due Friday

Project: Make sure you check what’s due when!