As the panelists gathered onstage for SC21s first plenary talk, the so-called Peter Parker principle with great power comes great responsibility cycled across the background slideshow. For the following hour, five panelists confronted this dilemma: with the transformative power of HPC (and, in particular, HPC-enabled AI) increasingly mainstreamed and deployed by all major sectors of society, industry and government, what ethical responsibilities are conferred to whom, and how can those responsibilities be fulfilled?
The plenary, titled The Intersection of Ethics and HPC, featured five speakers: Dan Reed, professor of computer science and senior vice president of Academic Affairs at the University of Utah, who moderated the discussion; Cristin Goodwin, general manager and associate general counsel for Microsoft; Tony Hey, a physicist and chief data scientist for Rutherford Appleton Laboratory; Ellen Ochoa, chair of the National Science Board and former astronaut and director of NASAs Johnson Space Center; and Joel Saltz, an MD-PhD working as a professor and chair of the Department of Biomedical Informatics at Stony Brook University.
We know that advanced computing now pervades almost every aspect of science, technology, business, and society. Think about its impacts on financial institutions, e-commerce, communications, logistics, health, national security And big tech overall has been in the news lately and not necessarily in a good way, Reed opened, citing a Pandoras box of issues ranging from the effects of social media and data breaches to deepfakes and autonomous vehicles.
Unintended consequences and unethical actors
Technology, he continued, is also being exploited at scale, with governments and criminals leveraging high-power surveillance and intrusion tools to great effect. Beyond the national security applications and implications, HPC has also become tightly tied to competitiveness for businesses and to the state-of-the-art for forward-facing fields like medicine and consumer technology. HPC, Reed pointed out, is just the latest field to go through this tumultuous adolescence: fields like physics and medicine had experienced similar ethical dilemmas as their capabilities expanded.
As a physicist, Hey agreed, invoking perhaps the most famous step change in the ethical onus on a scientific field. I think the outstanding example is the Manhattan Project, which developed the atomic bomb during the war, he said. The Manhattan Project, he explained, had been initiated due to the fear of an unethical actor Hitler who likely would not have hesitated to use such a weapon were it in his possession. That was the original motivation. But actually before they tested their nuclear weapons that theyd developed in the Manhattan Project, Germany had surrendered. So the original reason had gone, he said leaving the scientists to wrestle with their creation. And I think, really, you can almost replace nuclear weapon technology with AI technology. You cant uninvent it, and we can be ethical about our use, but well have enemies who arent.
These enemies, and wantonly unethical actors generally, were the subject of much discussion. Goodwin, who works to address nation-state attacks at Microsoft, said that while cyberattacks by nation-states were once considered unlikely force majeure events, theyre now commonplace: Microsoft, between the period of August 2018 and this past July, notified over 20,000 customers of nation-state attacks, she said.
In my space, what I see all the time is the paradigm of unethical abuse, she added, contrasting that with the paradigm of ethical use. How are you thinking about abuse? The September 12th cockpit door? What are the ways your technology could be abused? This issue, she said, was particularly spotlit in the wake of Microsofts ill-fated chatbot, Tay.
Many people know that Microsoft back in 2016 had released a chatbot, and you could interact on Twitter and it would respond back to you, she recapped. And in about 24 hours it turned into a misogynistic Nazi and we took it down very, very quickly. And that forced Microsoft to go and look very very closely at how we think about ethics and artificial intelligence. It prompted us to create an office of responsible AI and a principled approach to how we think about that.
This kind of unanticipated reappropriation or redirection of a technology somewhat limited in scope, though offensive, when applied to a chatbot becomes much more ominous as the technologies expand. Saltz advised the audience to look beyond what [the] specific application is, citing the relatively straightforward introduction of telehealth which is now spiraling into the use of AI facial and body recognition to, in combination with medical records, make predictions for a patients health during a telehealth appointment. Pretty much every new technical advance, even if it seems relatively limited, can be extended and is being extended to something more major, he said.
Uninclusive models and unsuitable solutions
On the topic of unintended consequences, several of the panelists expressed concern over the bias that can be conferred often accidentally to AI models and their predictions through improper design and training. Ochoa referenced a famous case where an AI model was used to predict recidivism in sentencing, which, she said, resulted in the AI essentially predicting where police were deployed. These things can creep in at various different areas, but theyre being used so broadly theyre really affecting peoples lives, she said.
Indeed, much of this bias can be attributed to sample selection. To that point, Saltz spoke on the use of HPC-powered models to aid in diagnosis, prognosis and treatment. Medicine is a particular font of ethical dilemmas, theres no doubt and increasingly, these involve high-end computing and computational abilities, he said. Do you recommend an intensive, scorched-earth treatment for a patient to give them the best chance of beating cancer, or do you recommend a less taxing treatment because theyre unlikely to require anything more severe to recover? So, models can predict this, Saltz said. On the other hand: can models predict this? This is a major technical issue as well as an ethical issue. One of the main issues, again: if a particular population was used for training, how do you generalize that model? Should you?
Saltz had a couple of ideas for how to ameliorate these problems starting with the collection of more data from more groups. As human beings, we should encourage medical research and make our data available, he said. Theres a lot of work associated with this, but I think that convincing the citizenry that there really is a potential huge upside to participating in research studies and making their data available will be very important to enhance medical progress.
Second, he said, was validating the algorithms. The FDA has a project dedicated to validation of AI in medicine that were involved in, he explained. The notion is that thered be a well-defined path so that developers of algorithms can know when their algorithm has been deemed good enough to be reliable.
I think that also speaks to the notion that you want a diverse community looking at those issues, Reed said, because they will surface things that a less diverse community might not. Recommendations, too, can be asymmetrical: Hey explained how fine-grain tornado prediction enabled disaster agencies to recommend fewer evacuations along a more specific path, but that for groups that might need longer to evacuate such as people with disabilities, or older people that more targeted, quicker-response approach might be unsuitable. These things require great consideration of the people who are affected, he said.
Unfathomable explanations and unrepresentative gatherings
One core problem pervades nearly all efforts to reinforce ethics in HPC and AI: comprehension.
We are a vanishingly small fraction of the population so how do we think about informed debate and understanding with the broader community about these complex issues? Reed said. Because explaining to someone that, this is a multidisciplinary model with some abstractions based on AI and some inner loops, and weve used a numerical approximation technique with variable precision arithmetic on a million-core system with some variable error rate, and now talk to me about whether this computation is right that explanation is dead on arrival to the people who would care about how these systems are actually used.
Goodwin said that getting users, stakeholders and the general public to understand the implications of technological developments or threats was something that Microsoft had been wrestling with for some time. We have context analysts that help us simplify the way we talk about what weve learned so that communities that are not technical or not particularly comfortable with technical terms can consume that, she said. What we believe is that you cant have informed public policy if you cant take the technical detail of an attack and make it relatable for those who need to understand that.
When talking about communication between HPC or AI insiders and the general public, of course, its important to note the differences between those two groups differences that span demographics, not just credentials. The attendees at this conference are not broadly representative of our population, Reed said, gently, looking out at the audience.
Ochoa followed up on that thread, discussing efforts to fold in the missing millions that are often left unrepresented by gatherings of or decisions by technically skilled, demographically similar experts.
We try to make sure were not doing anything discriminatory, right? she said. But welcoming is actually much broader than that.
- Eckerd computer science professors 'think outside' to boost wildlife research - Eckerd College News - January 16th, 2022
- CAMEO Project Manager, UCD School of Computer Science job with UNIVERSITY COLLEGE DUBLIN (UCD) | 277887 - Times Higher Education (THE) - January 16th, 2022
- Could artificial intelligence help predict Louisiana floods better? This LSU prof thinks so. - The Advocate - January 16th, 2022
- CRCs appointed at UBC Science in ecology, computer science, and astrophysics - UBC Faculty of Science - January 16th, 2022
- The Lies that Powered the Invention of Pong - IEEE Spectrum - January 16th, 2022
- Maryland Today | Two Terps Named 2022 Churchill Scholars - Maryland Today - January 16th, 2022
- "Bosom peril" is not "breast cancer": How weird computer-generated phrases help researchers find scientific publishing fraud -... - January 16th, 2022
- At IITs, Computer Science students offered job packages worth crores - The Indian Express - January 16th, 2022
- Robotic assistive device will lend a helping hand to infants with movement difficulties - UC Riverside - January 16th, 2022
- Unicorn startups: The education of 3 business leaders - Study International News - January 16th, 2022
- Computer Science for Fun - cs4fn: HOME - January 6th, 2022
- Redirect your career path in 2022 with this $20 computer science training bundle - PCWorld - January 6th, 2022
- Making computation come alive | MIT News | Massachusetts Institute of Technology - MIT News - January 6th, 2022
- International recognition for Southampton Electronics and Computer Science graduate - University of Southampton - January 6th, 2022
- Lior Cole Is The Model Combining Artificial Intelligence With Religion - British Vogue - January 6th, 2022
- UNM's VolCAN team makes history in Canary Islands - UNM Newsroom - January 6th, 2022
- FIRST Robotics Competition inspires a new wave of local talent in information technology - News 5 Cleveland - January 6th, 2022
- The convergence of deep neural networks and immunotherapy - TechCrunch - January 6th, 2022
- Machine and Human Factors in Misinformation Management - Information Processing and Management Conference - Knovel - January 6th, 2022
- EeroQ Chooses the Terminal in Chicago for 9,600 Square Foot Quantum Computing Lab - Yahoo Finance - January 6th, 2022
- A Year After the Capitol Insurrection, Faith in Democracy Wanes - News @ Northeastern - News@Northeastern - January 6th, 2022
- Do the Legal Rules Governing the Confidentiality of Cyber Incident Response Undermine Cybersecurity? - Lawfare - January 6th, 2022
- Mr. Jeroen Tas Joins Zylorion as a Strategic Advisor and Observer to the Board of Directors - PRNewswire - January 6th, 2022
- Kerstin Perez is searching the cosmos for signs of dark matter - MIT News - January 2nd, 2022
- The age of hyper-accelerated AI adoption | Ctech - CTech - January 2nd, 2022
- 2 Cryptocurrencies That Could Outpace Bitcoin - The Motley Fool - January 2nd, 2022
- Places You're Most Likely to Catch Omicron Eat This Not That - Eat This, Not That - January 2nd, 2022
- Children to be empowered with future skills - The News International - January 2nd, 2022
- AI Weekly: AI prosecutors and pong-playing neurons closed out 2021 - VentureBeat - December 31st, 2021
- Places "Swarming" With COVID, Say Experts Eat This Not That - Eat This, Not That - December 31st, 2021
- Global economy and development in 2021: What we learned in Brookings Global - Brookings Institution - December 31st, 2021
- Book Review: Artificial Intelligence and Computing Logic- Cognitive Technology for AI Business Analytics - Analytics Insight - December 31st, 2021
- Have a better 2022 with these tech resolutions - MIT Technology Review - December 31st, 2021
- Opinion: Connecticut's hottest takes of 2021 - CT Insider - December 31st, 2021
- Machines that see the world more like humans do - Big Think - December 31st, 2021
- 10 Inspiring LGBTQIA Technology Executives And Their Stories - Forbes - December 31st, 2021
- BYU graduate student spearheads the creation of 3D campus model - Daily Herald - December 31st, 2021
- Count down the top 10 Futurity posts of 2021 - Futurity: Research News - December 31st, 2021
- Professor, Level E in Computer Science job with GRIFFITH UNIVERSITY | 275769 - Times Higher Education (THE) - December 22nd, 2021
- 21 Interesting Knox Students and Alumni We Met in 2021 - Knox College - December 22nd, 2021
- Undergraduate finds room to explore business, computer science, and an American music icon - University of Rochester - December 22nd, 2021
- These Are the Best Online Courses You Can Take - gearpatrol.com - December 22nd, 2021
- YU's Registration Process Was Flawed. One Student Decided To Fix That. - The Commentator - The Commentator - December 22nd, 2021
- UWO's new cybersecurity center offers experience with real-world cyber threats - UW Oshkosh Today - UW Oshkosh Today - December 22nd, 2021
- Creating Text Out of Thin Air - IEEE Spectrum - December 22nd, 2021
- Ethics and society review: Ethics reflection as a precondition to research funding - pnas.org - December 22nd, 2021
- Launching your computer science career in the Air Force - ZDNet - December 20th, 2021
- Multi-million pound investment to keep Southampton at forefront of Computer Science and Artificial Intelligence | Electronics and Computer Science |... - December 20th, 2021
- Editorial: OU-Tulsa computer science expansion will have long-term payoffs - Tulsa World - December 20th, 2021
- Lecturer in Computer Science, NLP/ML job with ROYAL HOLLOWAY, UNIVERSITY OF LONDON | 275275 - Times Higher Education (THE) - December 20th, 2021
- Cornell Tech celebrates 10th anniversary of winning NYC competition | Cornell Chronicle - Cornell Chronicle - December 20th, 2021
- New UW-Eau Claire grad 'pays it forward,' works to make computer science field more equitable and inclusive - University of Wisconsin System - December 20th, 2021
- Many ignored their fitness during COVID. So this CT teen made an award-winning app to encourage healthy habits. - Darien Times - December 20th, 2021
- Graduate learns the value of time spent with others - UNM Newsroom - December 20th, 2021
- Best cybersecurity schools and programs - ZDNet - December 20th, 2021
- Two SSIE PhD candidates explore their futures at faculty diversity program | Binghamton News - Binghamton University - December 20th, 2021
- Accelerating Discovery: Optimizing Workflows to Advance the Use of AI for Science - HPCwire - December 20th, 2021
- Last of UCF Quadruplets Graduates Within same year as Siblings - UCF - December 20th, 2021
- Tracy Camp Named Computing Research Association Executive Director - PRNewswire - December 20th, 2021
- Music based brain-computer interfaces an interview with Stefan Ehrlich and Kat Agres - EveryONE - PLoS Blogs - December 20th, 2021
- Morning Lookout: One eye on the weather, integrating computer science, and surf equity - Lookout Santa Cruz - December 14th, 2021
- UMass Amherst to Offer Scholarships to 40 Students, Boosting Diversity in Data Science - UMass News and Media Relations - December 14th, 2021
- Considering the Why and Not Just the How of Computer Science - Bowdoin News - December 14th, 2021
- Maryland Today | $4.75M Gift Establishes Brin Mathematics Research - Maryland Today - December 14th, 2021
- Texas A&M works to shape the next generation of computer scientists - KAGSTV.com - December 14th, 2021
- $7 million gift from the Shiv Nadar Foundation bolsters undergraduate research and women in EECS - MIT News - December 14th, 2021
- UCF Researchers Ethanol Fuel Cells Offer New Alternative to Power Cars, Technology - UCF - December 14th, 2021
- Chantel Parnell: Working to Diversify Tech - California Teachers Association - December 14th, 2021
- Decoding the science of coding in just one hour - CBS46 News Atlanta - December 14th, 2021
- Kronos Ransomware Update: Estimated Time To Be Fixed, Efforts of UKG's Clients, and Other New Details - Tech Times - December 14th, 2021
- Sant Announces Expansion Of Ventures Team With The Addition Of Auriel August, MD, Ashley Seehusen, and Michael Gutbrod - PRNewswire - December 14th, 2021
- UW-Green Bay's Rising Phoenix Program Expands with Computer Science Pathway for Students Across the Region - Inside UW-Green Bay News - UWGB - December 8th, 2021
- Machines that see the world more like humans do - MIT News - December 8th, 2021
- Apple, Boys & Girls Clubs team up to offer coding opportunities to kids, teens - Apple Newsroom - December 8th, 2021
- UCF Professor Greg Welch Named to the National Academy of Inventors - UCF - December 8th, 2021
- SAP : Helping to Close the Computer Science Education Disparity - marketscreener.com - December 3rd, 2021
- Women of the Well House supports new campus programs: Indiana University Kokomo - IUK Newsroom - December 3rd, 2021
- Diving Into The Strange World Of Xenobots - Science Friday - December 3rd, 2021
- Silicon Valley beckoned, but he went home to Delaware - MIT News - December 3rd, 2021
- Two UB faculty receive NSF funding to study social media in disaster response - UB Now: News and views for UB faculty and staff - University at... - December 3rd, 2021