{"@context":"http://iiif.io/api/presentation/3/context.json","id":"https://ualberta.aviaryplatform.com/iiif/gh9b56fm01/manifest","type":"Manifest","label":{"en":["The Flaws of Policies Requiring Human Oversight of Government Algorithms"]},"logo":"https://d9jk7wjtjpu5g.cloudfront.net/organizations/logo_images/000/000/128/original/UA_Logo_WHT_RGB_%281%29.png?1725471982","metadata":[{"label":{"en":["Agent"]},"value":{"en":["Green, Ben (Creator)","Kule Institute for Advanced Studies (KIAS) (Sponsor)","AI for Society (AI4S) (Sponsor)","Centre for New Economic Diplomacy (CNED) (Sponsor)","Broadcasting Commission of Jamaica (Sponsor)"]}},{"label":{"en":["Date"]},"value":{"en":["2022-09-28 (issued)"]}},{"label":{"en":["Publisher"]},"value":{"en":["UNESCO Information For All Programme (IFAP)","Working Group on Information Accessibility (WGIA)"]}},{"label":{"en":["Coverage"]},"value":{"en":["USA (Place of recording)"]}},{"label":{"en":["Description"]},"value":{"en":["As algorithms become an influential component of government decision-making around the world, policymakers have debated how governments can attain the benefits of algorithms while preventing the harms of algorithms. One mechanism that has become a centerpiece of global efforts to regulate government algorithms is to require human oversight of algorithmic decisions. Despite the widespread turn to human oversight, these policies rest on an uninterrogated assumption: that people are able to effectively oversee algorithmic decision-making. In this talk, I survey policies that prescribe human oversight of government algorithms and find that they suffer from two significant flaws. Thus, rather than protect against the potential harms of algorithmic decision-making in government, human oversight policies provide a false sense of security in adopting algorithms and enable vendors and agencies to shirk accountability for algorithmic harms. In light of these flaws, I propose a shift from human oversight to institutional oversight as the central mechanism for regulating government algorithms. \u003cbr\u003eTheme: Collaborating to achieve AI Accessibility through leadership, learning, innovation and trust with reference to SDG 6, 7, 8, 10, 11, 12, 16, 17. \u003cbr\u003eSubtopic: Ethical Digital Transformation (including socially-rooted AI deployment, infrastructure, content, government and legal structures, and e-governance). (Abstract)"]}},{"label":{"en":["Language"]},"value":{"en":["English"]}},{"label":{"en":["Relation"]},"value":{"en":["\u003ca href=\"https://ai4iaconference.com/\"\u003eAI4IA Annual Conference\u003c/a\u003e"]}},{"label":{"en":["Subject"]},"value":{"en":["Artificial intelligence (topical)","Artificial intelligence--Moral and ethical aspects (topical)","Artificial intelligence--Law and legislation (topical)","Algorithms (topical)","Human oversight (topical)","Algorithms--Social aspects (topical)","Governance (topical)"]}},{"label":{"en":["Type"]},"value":{"en":["Event"]}},{"label":{"en":["Rights Statement"]},"value":{"en":["\u003ca href=\"https://creativecommons.org/licenses/by-nc/4.0/\"\u003eAttribution-NonCommercial 4.0 International\u003c/a\u003e"]}},{"label":{"en":["Series or Event Name"]},"value":{"en":["Artificial Intelligence for Information Accessibility (AI4IA) Conference, 2022"]}}],"summary":{"en":["As algorithms become an influential component of government decision-making around the world, policymakers have debated how governments can attain the benefits of algorithms while preventing the harms of algorithms. One mechanism that has become a centerpiece of global efforts to regulate government algorithms is to require human oversight of algorithmic decisions. Despite the widespread turn to human oversight, these policies rest on an uninterrogated assumption: that people are able to effectively oversee algorithmic decision-making. In this talk, I survey policies that prescribe human oversight of government algorithms and find that they suffer from two significant flaws. Thus, rather than protect against the potential harms of algorithmic decision-making in government, human oversight policies provide a false sense of security in adopting algorithms and enable vendors and agencies to shirk accountability for algorithmic harms. In light of these flaws, I propose a shift from human oversight to institutional oversight as the central mechanism for regulating government algorithms. \u003cbr\u003eTheme: Collaborating to achieve AI Accessibility through leadership, learning, innovation and trust with reference to SDG 6, 7, 8, 10, 11, 12, 16, 17. \u003cbr\u003eSubtopic: Ethical Digital Transformation (including socially-rooted AI deployment, infrastructure, content, government and legal structures, and e-governance)."]},"requiredStatement":{"label":{"en":["Attribution"]},"value":{"en":["\u003ca href=\"https://creativecommons.org/licenses/by-nc/4.0/\"\u003eAttribution-NonCommercial 4.0 International\u003c/a\u003e"]}},"provider":[{"id":"https://ualberta.aviaryplatform.com/aboutus","type":"Agent","label":{"en":["University of Alberta Library"]},"homepage":[{"id":"https://ualberta.aviaryplatform.com/","type":"Text","label":{"en":["University of Alberta Library"]},"format":"text/html"}],"logo":[{"id":"https://d9jk7wjtjpu5g.cloudfront.net/organizations/logo_images/000/000/128/original/UA_Logo_WHT_RGB_%281%29.png?1725471982","type":"Image"}]}],"thumbnail":[{"id":"https://d9jk7wjtjpu5g.cloudfront.net/collection_resource_files/thumbnails/000/210/563/small/BGreen-TheFlawsOfPolicies.mp4_1698716128.jpg?1698701732","type":"Image","format":"image/jpeg"}],"items":[{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563","type":"Canvas","label":{"en":["Media File 1 of 1 - B_Green_-_The_Flaws_Of_Policies.mp4"]},"duration":666.84,"width":640,"height":360,"thumbnail":[{"id":"https://d9jk7wjtjpu5g.cloudfront.net/collection_resource_files/thumbnails/000/210/563/small/BGreen-TheFlawsOfPolicies.mp4_1698716128.jpg?1698701732","type":"Image","format":"image/jpeg"}],"items":[{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/content/1","type":"AnnotationPage","items":[{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/content/1/annotation/1","type":"Annotation","motivation":"painting","body":{"id":"https://aviary-p-ualberta.s3.wasabisys.com/collection_resource_files/resource_files/000/210/563/original/B_Green_-_The_Flaws_Of_Policies.mp4?1698701728","type":"Video","format":"video/mp4","duration":666.84,"width":640,"height":360},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563","metadata":[]}]}],"annotations":[{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336","type":"AnnotationPage","label":{"en":["The Flaws of Policies Requiring Human Oversight of Government Algorithms [Transcript]"]},"items":[{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/1","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"hey everyone my name is Ben green and","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=3.05,3.06"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/2","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"I'm excited to talk to you about some of","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=6.17,6.18"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/3","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"the important topics around AI","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=9.53,9.54"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/4","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"regulation governance ethics and human","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=12.47,12.48"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/5","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"algorithm interactions in particular","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=15.11,15.12"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/6","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"I'll focus on the emerging set of","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=18.05,18.06"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/7","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"policies that require human oversight of","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=20.57,20.58"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/8","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"algorithms particularly algorithms used","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=23.09,23.1"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/9","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"by government agencies and talk about","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=25.07,25.08"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/10","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"some of the challenges of where those","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=26.57,26.58"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/11","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"regulations although intuitively","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=28.429,28.439"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/12","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"appealing falls short","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=31.37,31.38"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/13","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"the background of this work is the","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=33.95,33.96"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/14","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"increasing use of machine learning","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=35.51,35.52"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/15","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"algorithms by government agencies","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=37.97,37.98"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/16","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"on the one hand many are excited about","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=40.67,40.68"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/17","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"the opportunities that these algorithms","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=42.709,42.719"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/18","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"bring to improve the accuracy fairness","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=45.11,45.12"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/19","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"and consistency of decision making and","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=48.11,48.12"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/20","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"this has led to the adoption of","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=49.43,49.44"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/21","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"algorithms in domains such as pre-trial","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=52.01,52.02"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/22","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"release child welfare and Public Health","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=55.49,55.5"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/23","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"yet despite the optimism motivating","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=57.35,57.36"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/24","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"government algorithms the implementation","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=59.27,59.28"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/25","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"of these tools has been marked by","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=61.13,61.14"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/26","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"controversies and injustices government","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=63.77,63.78"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/27","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"algorithms are often Rife with errors","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=65.99,66.0"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/28","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"they discriminate against racial","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=67.85,67.86"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/29","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"minorities and fail to provide","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=69.73,69.74"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/30","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"context-appropriate judgments","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=72.649,72.659"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/31","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"these competing hopes and fears about","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=74.57,74.58"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/32","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"algorithms raises a dilemma for policy","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=77.51,77.52"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/33","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"makers how can governments attain","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=79.789,79.799"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/34","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"benefits from algorithms while avoiding","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=81.95,81.96"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/35","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"the risks","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=83.57,83.58"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/36","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"and across the world one increasingly","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=85.969,85.979"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/37","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"common response to this question is to","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=88.429,88.439"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/38","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"require human oversight of the decisions","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=90.59,90.6"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/39","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"rendered by algorithms so I'm talking","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=93.289,93.299"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/40","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"specifically here about uh oversight","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=96.59,96.6"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/41","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"human oversight and intervention in the","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=99.59,99.6"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/42","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"specific outputs of an algorithmic model","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=103.31,103.32"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/43","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"so let me give you a couple examples of","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=105.53,105.54"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/44","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"what these policies look like one","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=107.81,107.82"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/45","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"notable example is the landmark AI act","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=110.749,110.759"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/46","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"that the European commission proposed","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=112.85,112.86"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/47","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"last spring which writes for high risk","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=115.49,115.5"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/48","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"AI systems human oversight is strictly","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=117.95,117.96"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/49","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"necessary to mitigate the risks to","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=119.929,119.939"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/50","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"fundamental rights and safety posed by","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=122.21,122.22"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/51","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"AI","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=122.22,123.479"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/52","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"similarly a Canadian directive on","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=125.81,125.82"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/53","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"automated decision making writes that","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=127.85,127.86"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/54","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"decisions likely to have high or very","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=129.949,129.959"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/55","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"high social impacts cannot be made","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=132.35,132.36"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/56","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"without having specific human","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=133.97,133.98"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/57","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"intervention points during the","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=135.589,135.599"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/58","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"decision-making process and the final","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=137.869,137.879"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/59","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"decision must be made by a human","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=141.35,141.36"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/60","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"so these oversight policies uh enable","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=145.49,145.5"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/61","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"governments to use algorithms as long as","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=147.77,147.78"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/62","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"a human has oversight or control over","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=150.29,150.3"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/63","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"the final decision and uh then the","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=153.53,153.54"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/64","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"central question that I explored in my","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=155.75,155.76"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/65","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"research is what do these policies","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=158.21,158.22"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/66","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"actually say and how do they work uh as","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=161.27,161.28"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/67","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"part of this research I looked at uh 41","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=163.97,163.98"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/68","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"different policies around the world that","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=166.25,166.26"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/69","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"requires some form of human oversight as","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=168.83,168.84"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/70","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"a mechanism for regulating algorithms so","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=171.83,171.84"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/71","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"let me dig in a little bit more","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=173.809,173.819"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/72","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"so the first question is what do these","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=176.75,176.76"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/73","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"human oversight policies actually","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=178.49,178.5"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/74","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"propose and we can break down these","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=181.43,181.44"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/75","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"policies into three different categories","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=183.61,183.62"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/76","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"the first approach restricts solely","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=186.589,186.599"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/77","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"automated decisions these essentially","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=188.869,188.879"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/78","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"say that solely automated decisions are","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=191.33,191.34"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/79","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"prohibited by default and where allowed","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=193.91,193.92"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/80","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"subjects must have the right to human","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=195.89,195.9"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/81","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"intervention an example here is the gdpr","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=199.07,199.08"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/82","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"which in article 22 states that the data","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=202.49,202.5"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/83","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"subject shall have the right not to be","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=204.53,204.54"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/84","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"subject to a decision based solely on","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=206.99,207.0"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/85","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"automated processing","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=209.27,209.28"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/86","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"the second approach is to require human","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=212.149,212.159"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/87","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"discretion in decision making as we can","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=214.97,214.98"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/88","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"see in the guide for the compass risk","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=218.69,218.7"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/89","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"assessment algorithm for pre-trial and","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=220.55,220.56"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/90","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"sentencing decisions North Point the","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=222.83,222.84"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/91","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"creator of this algorithm wrote that","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=224.99,225.0"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/92","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"staff should be encouraged to use their","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=227.089,227.099"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/93","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"professional judgment and override the","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=229.43,229.44"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/94","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"computed risk as appropriate essentially","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=232.49,232.5"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/95","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"here these policies say that governments","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=235.07,235.08"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/96","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"may use algorithms as long as human","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=237.05,237.06"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/97","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"decision makers have discretion to","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=239.089,239.099"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/98","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"override the algorithm and make the","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=241.13,241.14"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/99","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"final decision","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=242.869,242.879"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/100","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"and the third approach is to require","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=245.149,245.159"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/101","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"meaningful human input","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=247.55,247.56"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/102","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"as the European article 29 data","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=250.85,250.86"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/103","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"protection working party wrote in","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=253.07,253.08"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/104","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"relation to the gdpr to qualify as human","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=256.189,256.199"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/105","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"involvement the controller must ensure","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=258.289,258.299"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/106","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"that any oversight of the decision is","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=260.509,260.519"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/107","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"Meaningful rather than just a token","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=262.73,262.74"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/108","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"gesture","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=262.74,263.94"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/109","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"so what this idea of meaningful entails","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=267.05,267.06"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/110","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"is somewhat vague but there are three","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=268.67,268.68"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/111","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"components that are typically required","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=270.65,270.66"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/112","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"the first is the ability of the human","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=273.11,273.12"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/113","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"decision maker to override the algorithm","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=275.15,275.16"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/114","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"similarly to be to the second approach","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=278.17,278.18"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/115","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"the second requirement is that the","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=280.61,280.62"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/116","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"decision maker must be able to","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=282.05,282.06"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/117","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"understand the algorithm through","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=283.67,283.68"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/118","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"explanations and transparency and the","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=286.43,286.44"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/119","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"third requirement is that the human","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=287.81,287.82"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/120","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"should avoid relying too heavily on","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=290.03,290.04"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/121","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"algorithms they must incorporate other","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=292.07,292.08"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/122","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"other factors and information and values","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=296.93,296.94"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/123","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"so the next question to ask is do these","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=299.03,299.04"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/124","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"human oversight policies work they're","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=300.95,300.96"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/125","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"being implemented around the world as a","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=303.05,303.06"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/126","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"safeguard against the risks of","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=304.79,304.8"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/127","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"algorithms so we really want to","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=306.89,306.9"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/128","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"understand how do these policies work uh","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=309.83,309.84"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/129","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"and what lessons can we learn about the","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=311.87,311.88"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/130","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"construction of AI regulations","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=314.21,314.22"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/131","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"and what I argue is that these policies","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=316.43,316.44"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/132","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"suffer from two fundamental flaws","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=319.01,319.02"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/133","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"let me start with the first flaw which","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=321.71,321.72"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/134","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"is that human oversight policies are","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=323.749,323.759"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/135","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"actually not supported by empirical","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=325.55,325.56"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/136","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"evidence it's very intuitively appealing","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=328.55,328.56"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/137","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"and makes sense that we would want to","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=330.65,330.66"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/138","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"correct for concerns about algorithmic","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=333.23,333.24"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/139","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"errors and biases by ensuring that we","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=335.33,335.34"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/140","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"have a human in the loop of the","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=336.83,336.84"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/141","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"decision-making process but there's a","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=339.469,339.479"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/142","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"great deal of empirical evidence that","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=341.09,341.1"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/143","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"actually shows that people are not great","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=342.95,342.96"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/144","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"at performing this type of quality","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=344.93,344.94"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/145","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"control task","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=347.029,347.039"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/146","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"overall we find that human discretion","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=349.61,349.62"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/147","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"into algorithmic decisions does not tend","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=352.01,352.02"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/148","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"to improve outcomes even when human","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=354.469,354.479"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/149","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"oversight moves Beyond superficial","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=356.629,356.639"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/150","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"rubber stamp approaches","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=358.909,358.919"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/151","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"across a wide range of domains automated","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=361.37,361.38"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/152","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"decision support systems tend to alter","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=363.89,363.9"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/153","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"human decision making in unexpected and","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=366.29,366.3"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/154","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"often detrimental ways a notable example","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=368.99,369.0"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/155","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"of this is the phenomenon of automation","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=371.21,371.22"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/156","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"bias where people who are given the aid","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=375.59,375.6"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/157","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"of automated systems of various sorts","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=378.35,378.36"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/158","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"tend to decrease the independent","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=380.39,380.4"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/159","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"scrutiny and judgment that they put on","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=382.49,382.5"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/160","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"the decision-making task relying on the","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=384.89,384.9"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/161","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"automated system to make decisions for","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=387.11,387.12"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/162","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"them to a large extent","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=389.33,389.34"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/163","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"and moreover people are uh as","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=391.85,391.86"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/164","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"experimental studies from the last","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=393.35,393.36"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/165","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"several years have shown people struggle","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=395.689,395.699"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/166","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"to judge the quality of algorithmic","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=397.61,397.62"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/167","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"outputs and determine when to override","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=399.83,399.84"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/168","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"those outputs uh numerous Studies have","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=402.71,402.72"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/169","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"shown that human judgments about when to","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=404.87,404.88"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/170","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"override algorithms are often Incorrect","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=407.33,407.34"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/171","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"and often inject racial bias into the","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=410.15,410.16"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/172","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"decision-making process","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=412.01,412.02"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/173","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"and this plays out in real world context","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=415.01,415.02"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/174","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"as well where judges in the United","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=417.83,417.84"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/175","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"States have been shown to override","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=419.629,419.639"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/176","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"pre-trial risk Assessments in punitive","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=422.45,422.46"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/177","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"and racially biased ways","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=425.51,425.52"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/178","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"and these challenges continue even when","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=428.09,428.1"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/179","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"we turn to so-called meaningful human","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=430.55,430.56"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/180","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"oversight","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=430.56,431.819"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/181","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"the three components of meaningful human","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=433.85,433.86"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/182","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"oversight that I described are either","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=436.189,436.199"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/183","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"unlikely to improve decision making or","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=438.59,438.6"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/184","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"are very difficult to achieve","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=441.29,441.3"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/185","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"first people typically override","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=443.089,443.099"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/186","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"algorithms in detrimental ways as I just","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=445.55,445.56"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/187","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"described on the prior slide","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=448.909,448.919"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/188","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"second explanations and transparency do","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=451.79,451.8"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/189","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"not tend to improve human oversight","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=453.85,453.86"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/190","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"often these AIDS increase someone a","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=457.55,457.56"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/191","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"person's trust in the algorithm and the","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=459.77,459.78"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/192","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"algorithm's advice but is not connected","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=461.93,461.94"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/193","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"to the actual quality of the system","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=465.23,465.24"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/194","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"and finally it's very hard for people to","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=468.11,468.12"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/195","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"avoid relying too heavily on algorithms","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=470.45,470.46"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/196","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"uh there is automation bias as I","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=473.45,473.46"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/197","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"described that continues even despite","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=475.49,475.5"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/198","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"training and recommendations to not rely","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=477.95,477.96"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/199","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"too heavily on the algorithm and","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=480.469,480.479"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/200","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"algorithmic advice can alter how humans","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=483.17,483.18"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/201","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"are balancing different values and","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=486.469,486.479"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/202","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"priorities in the decision-making","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=487.909,487.919"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/203","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"process","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=487.919,490.259"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/204","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"so this first flaw then leads to a","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=492.589,492.599"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/205","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"second flaw where rather than protecting","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=494.93,494.94"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/206","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"against the harms of government","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=496.85,496.86"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/207","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"algorithms human oversight policies tend","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=499.61,499.62"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/208","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"to legitimize flawed and unaccountable","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=501.95,501.96"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/209","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"algorithms of government","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=503.93,503.94"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/210","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"and this occurs in two primary ways the","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=507.83,507.84"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/211","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"first is that human oversight policies","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=509.57,509.58"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/212","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"provide a false sense of security in","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=511.67,511.68"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/213","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"adopting algorithms these policies make","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=514.19,514.2"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/214","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"it seem legitimate for governments to","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=516.35,516.36"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/215","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"deploy algorithms in a wider variety of","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=518.99,519.0"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/216","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"high-stage settings But ultimately human","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=521.69,521.7"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/217","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"oversight fails to address the","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=523.43,523.44"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/218","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"underlying concerns about inaccurate and","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=525.65,525.66"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/219","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"biased predictions","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=528.23,528.24"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/220","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"second human oversight diminishes","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=530.21,530.22"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/221","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"accountability for the institutional","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=532.37,532.38"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/222","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"decision makers who actually control","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=534.35,534.36"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/223","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"develop and Implement these systems","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=537.53,537.54"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/224","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"human oversight policies positioned","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=539.69,539.7"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/225","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"Frontline human operators as the","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=541.67,541.68"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/226","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"scapegoats for government algorithms","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=543.47,543.48"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/227","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"even though the harms of these systems","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=545.449,545.459"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/228","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"have been structured by more powerful","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=547.25,547.26"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/229","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"institutional actors when something goes","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=549.71,549.72"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/230","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"wrong these institutional decision","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=551.57,551.58"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/231","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"makers can blame the human who is","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=554.15,554.16"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/232","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"charged with oversight even if those","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=556.19,556.2"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/233","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"algorithms should never have been","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=557.57,557.58"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/234","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"installed in the first place and if we","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=559.79,559.8"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/235","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"never should have be expecting the human","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=562.37,562.38"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/236","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"overseer to actually perform that","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=564.59,564.6"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/237","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"function","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=564.6,566.64"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/238","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"so the question then that we conclude","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=568.97,568.98"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/239","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"with is what is the alternative it's","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=571.13,571.14"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/240","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"clear that we must stop relying on human","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=573.23,573.24"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/241","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"oversight as a central mechanism for","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=575.389,575.399"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/242","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"protecting against the harms of","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=576.769,576.779"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/243","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"government algorithms but the answer","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=578.93,578.94"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/244","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"isn't simply to use algorithms without","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=580.79,580.8"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/245","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"human oversight or to say that we can","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=583.13,583.14"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/246","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"never use algorithms at all we need to","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=585.47,585.48"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/247","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"develop a different framework and in my","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=588.41,588.42"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/248","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"work I describe the importance of a","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=590.87,590.88"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/249","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"shift from Human oversight as a Band-Aid","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=593.99,594.0"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/250","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"to a broader form of institutional","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=596.449,596.459"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/251","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"oversight very briefly this I'll sketch","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=600.05,600.06"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/252","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"this idea of institutional oversight","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=601.73,601.74"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/253","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"that operates in two different stages","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=603.97,603.98"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/254","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"for an out for an agency that wants to","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=607.79,607.8"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/255","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"deploy an algorithm in a given setting","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=611.15,611.16"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/256","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"first and foremost the agency would be","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=613.31,613.32"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/257","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"required to provide proactive","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=615.05,615.06"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/258","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"justification and evaluation that","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=617.329,617.339"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/259","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"describes why the algorithm would be","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=619.61,619.62"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/260","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"beneficial and that any proposed human","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=621.949,621.959"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/261","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"oversight or collaboration mechanisms","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=624.29,624.3"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/262","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"have some basis of empirical support","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=626.99,627.0"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/263","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"and finally this uh this this process","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=630.889,630.899"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/264","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"would then require public review and","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=633.11,633.12"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/265","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"approval before an agency is actually","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=635.81,635.82"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/266","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"able to adopt an algorithm in practice","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=637.85,637.86"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/267","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"and so this process would shift the","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=640.49,640.5"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/268","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"burden much more heavily onto agencies","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=642.829,642.839"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/269","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"and vendors to proactively demonstrate","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=645.47,645.48"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/270","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"that the algorithm will be beneficial","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=647.449,647.459"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/271","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"and justify the how and why of uh","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=650.93,650.94"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/272","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"justify how they are implementing it and","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=653.09,653.1"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/273","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"regulating it thank you very much and I","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=655.67,655.68"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/274","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"look forward to conversation with all of","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=657.829,657.839"},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/275","type":"Annotation","motivation":"transcribing","body":{"type":"TextualBody","value":"you","format":"text/plain"},"target":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563#t=657.839,659.959"}]},{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336","type":"AnnotationPage","label":{"en":["English [Transcript]"]},"items":[{"id":"https://ualberta.aviaryplatform.com/collections/1845/collection_resources/109117/file/210563/transcript/61336/annotation/276","type":"Annotation","motivation":"subtitling","body":{"type":"TextualBody","value":"https://d9jk7wjtjpu5g.cloudfront.net/file_transcripts/associated_files/000/061/336/original/B_Green_-_The_Flaws_of_Policies_Requiring_Human_Oversight_of_Government_Algorithms.en.vtt?1699539330","format":"text/vtt","language":"en"},"target":"https://d9jk7wjtjpu5g.cloudfront.net/file_transcripts/associated_files/000/061/336/original/B_Green_-_The_Flaws_of_Policies_Requiring_Human_Oversight_of_Government_Algorithms.en.vtt?1699539330"}]}]}]}