Gender Inclusivity in AI Governance
- Gia Sajan & Doreen Abiero |
- November 12, 2024 |
- Artificial Intelligence
Gender Inclusivity in AI Governance
Introduction
The rapid advancement of artificial intelligence has significant implications for how societies are shaped and governed, and it is essential that these transformative technologies are developed and deployed in an inclusive and equitable manner. In the African context, where historical and structural inequalities have long persisted, the role of artificial intelligence (AI) in addressing challenges and creating opportunities must be carefully examined through a gender-sensitive lens.1
Gender inequality persists in various fields, including but not limited to fields within technology such as AI.2 Having a more inclusive pool of individuals working on datasets utilised for training AI models who are aware of the discrepancies surrounding AI on a sociological level has been described as key to addressing the inherent biases that are translated from humans to AI.3 The predictive nature of algorithms in converting datasets into patterns, alongside the underrepresentation of women in the developmental phase of AI systems, contributes significantly to the biases that manifest within them.4 AI systems globally have been testamentary to the gender biases embedded within various sectors such as employment, financial services, gender-based violence (GBV) and femicide detection, administrative services, education, healthcare, media, search engines and cyberspaces.5 Perpetuation of bias has been widely identified as a consequence of such AI systems, however beyond this, the methods through which such systems are eventually tested, also known as ‘benchmarks’, have equally been identified as contributory to perpetuation.6
The intersection of gender bias and algorithmic bias
Broadly, three main factors from social, institutional, design and implementation angles are identified as contributory to the gender biases in AI systems. These include gender stereotyping, lack of AI regulations, biased training datasets, lack of diversity in developers, AI’s nature amplifying the bias, and other contextual factors.7 A racial factor to such biases is also indicative of how specific groups of women, such as Black women, are affected based on stereotypical factors as outlined in a study.8 The study involved identifying biases in LLMs through five distinct scenarios-how a purchase is conducted, predicting the winner of a chess match, predicting the winner of an election, identifying the best athlete and employment-related queries.9 By applying different contexts and names that can be closely linked to specific groups of people racially or through gender, the responses LLMs gave in terms of advice, general perceptions and outcomes were evaluated.10 Consequently, it was found that biases that were most disadvantageous affected Black women.11
The need to go beyond a technical angle to such biases and tap into a socio-centric view has been heavily emphasised with the intent to promote ethical considerations, debunk stereotypes and create more inclusive AI systems.12 Kong’s study on intersectionality reveals that discrimination faced by coloured women does not necessarily stem from their gender or race but rather their diffused identity of being both.13 The root cause of such discrimination yet again falls on the attributes of datasets themselves being male and white, the biases within crowd workers who source datasets and overall structural injustices affecting women of colour as evidenced by various systems such as face-recognition algorithms.14
The case for developing countries
In developing countries, gender inequality persists against women with respect to AI, especially due to legal systems that are inherently unfavourable to women with respect to their right to privacy/data protection, hiring systems, as well as inaccessibility to education and technology.15 Other factors that contribute to gender bias include AI systems’ ability to engage in GBV and harassment as well its potential to replace women in the job market.16
‘Colonial models of AI’-Formulating AI systems with little to no contextual considerations in Africa have been described as a component that hinders the inclusion of diverse, marginalised, and underrepresented groups in processes where participation is key.17A closer look at the African continent reflects similar biases in gender due to factors such as accessibility and inclusion in the developmental and participation processes of AI systems.18 The lack of diversity and representation in the field of AI development19 has been well-documented.20 Women, particularly those from the global south, face significant barriers in accessing necessary education, training, and opportunities to participate in shaping these powerful technologies. This disparity has limited the ability of AI applications to be effective within African contexts, as the tools developed often fail to account for the needs and experiences of marginalised communities.21 Additionally, the impact such biases have on African women trickle down to their privacy and security due to contextual differences between AI developers and marginalised groups.22 Global power imbalances and politicised effects of technological advancement are also identified as influential in the systemic injustice that marginalised groups such as women face on a policy scale.23 This has been equally expressed in the space of AI education.24
Women in Africa have been identified as subjected to inequality economically, through education, the digital divide, from an entrepreneur angle, participation in science, technology, engineering and mathematics (STEM) as a field, as well as leadership.25
Datasphere-described as almost a collation of datasets and its relationship with society- has been highlighted as a concept that can mitigate gender bias within AI.26 In ensuring that data is sourced, processed, handled and protected, recognizing gender bias and establishing measures to this effect, there is a potential for gender bias to be mitigated.27 African countries such as Kenya’s efforts to re-train its language models, Nigeria in establishing rules to promote responsible AI governance and South Africa’s audits to ensure that healthcare systems are not disproportionately impacted by gender are evidentiary of African countries’ efforts towards addressing gender bias in AI.28
The African Observatory reaffirmed such biases in the country on Responsible AI’s representatives who expressed the need to incentivize women’s participation on all fronts given that the issues AI seeks to address primarily affect women.29 Carnegie Mellon University Africa’s representatives equally spoke to the positive impact that such integration would have socioeconomically through AI.30 Aside from participation and policy-making efforts, the need to deconstruct biases on a societal level was equally highlighted in the OECD-AU AI Governance Dialogue.31
In terms of policymaking, the need to preserve gender neutrality has often been highlighted as key to mitigating gender bias in Africa.32 However, the ability to foresee biases and outcomes resulting from such biases in data processing has been expressed to be a limitation.33 Emphasis has equally been made to having multi-sectoral inclusivity of women in developing AI to ensure systemic change, be it the development of the system itself or external factors surrounding regulation/governance.34Aligned with the ambition of promoting inclusivity on all facets stands the AU’s strategy on Gender Equality and Women’s Empowerment (GEWE), which has key pillars aimed at promoting education, tackling GBV/domestic violence, enhancing enforcement through regulation and overall participation of women in the decision-making process.35The necessity for AU member states to ratify the Maputo Protocol on Women’s Rights has been highlighted as critical to protecting women’s interests in the technology sector whilst promoting gender-specific programs to provide women education on AI and its impact across sectors.36
Recommendations
Addressing these challenges requires a comprehensive and multifaceted approach that prioritises gender equity and inclusivity. Governments, private sector actors, and civil society organisations must work collaboratively to invest in STEM education and training for women and girls, ensuring that the pipeline of talent for AI development is diverse and representative.37 Additionally, policies and regulations must be put in place to mitigate the risk of algorithmic bias and to ensure that AI-driven solutions are designed with the needs of marginalised communities in mind.38
International collaborations and knowledge-sharing can also play a crucial role in fostering a distinct African AI ecosystem that is responsive to local contexts and priorities. By embracing a gender-inclusive approach to AI governance, African nations can harness the transformative potential of these technologies to drive sustainable development, improve service delivery, and empower historically underrepresented groups.39 Through strategic partnerships and exchange of best practices, African stakeholders can learn from global experiences, adapt these learnings to their local realities, and develop innovative AI-driven solutions that address the unique needs and challenges of the region.40 This collaborative approach can help build local capacity, foster innovation, and ensure that the benefits of AI are equitably distributed across diverse communities. By prioritising gender inclusivity in the development and deployment of AI in Africa, these technologies can become powerful enablers of social and economic progress, empowering women and other marginalised groups to participate fully in the digital transformation of the continent.41
Simultaneously, policymakers must develop comprehensive regulatory frameworks that mandate the rigorous consideration of gender and intersectional impacts throughout the entire lifecycle of AI systems – from design and development to deployment and governance.42 Such frameworks should ensure that marginalised communities, particularly women and gender minorities, are actively involved in shaping AI initiatives’ priorities, processes, and outcomes, thereby promoting more inclusive and equitable AI-driven solutions.
Additionally, the development of AI-powered solutions must be grounded in a deep understanding of the local context, drawing on insights and lived experiences of marginalised communities. This will not only enhance the effectiveness of these technologies but also contribute to a more equitable and inclusive AI ecosystem in Africa. Engaging with marginalised communities, including women, ethnic minorities, and people with disabilities, to understand their unique needs, challenges, and perspectives is crucial for designing AI systems that are responsive to the diverse realities and priorities of the African continent. By actively involving these stakeholders in the design, development, and deployment of AI-driven solutions, policymakers and technology developers can ensure that the benefits of AI are equitably distributed and that no one is left behind in the digital transformation of Africa.43
Conclusion
Embracing a gender-inclusive approach to AI governance in Africa is crucial for harnessing the transformative potential of these technologies to drive sustainable development, improve service delivery, and empower historically underrepresented groups. By prioritising diversity, equity, and inclusion throughout the entire lifecycle of AI systems, African nations can build a distinct and responsive AI ecosystem that addresses the unique needs and challenges of the region. Through strategic partnerships, knowledge-sharing, and rigorous policy frameworks, stakeholders can work collaboratively to ensure that the benefits of AI are equitably distributed and that no one is left behind in the continent’s digital transformation.
1 Chinasa T. Okolo, Kehinde Aruleba, George Obaido (2023). ‘Responsible AI in Africa—Challenges and Opportunities.’ In: Eke, D.O., Wakunuma, K., Akintoye, S. (eds) Responsible AI in Africa. Social and Cultural Studies of Robots and AI. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-031-08215-3_3 accessed 14 October 2024.
2 Adra Manasi, Subadra Panchanadeswaran and Emily Sours, ‘Addressing Gender Bias to Achieve Ethical AI’ IPI Global Observatory, 2023, <Addressing Gender Bias to Achieve Ethical AI>, accessed on 14 October 2024.
3 Josh Feast, ‘4 Ways to Address Gender Bias in AI’, Harvard Business Review, 2019, <4 Ways to Address Gender Bias in AI>, accessed on 14 October 2024.
4 Genevieve Smith and Ishita Rustagi, ‘When Good Algorithms Go Sexist: Why and How to Advance AI Gender Equity’, Stanford Social Innovation Review, 2021, <When Good Algorithms Go Sexist: Why and How to Advance AI Gender Equity> accessed on 14 October 2024.
5 Ivana Bartoletti and Raphaële Xenidis, ‘Study on the impact of artificial intelligence systems, their potential for promoting equality, including gender equality, and the risks they may cause in relation to non-discrimination’, Gender Equality Commission and the Steering Committee on Anti-Discrimination, Diversity and Inclusion (CDADI) Council of Europe, 2023, <Study on the impact of artificial intelligence systems, their potential for promoting equality, including gender equality, and the risks they may cause in relation to non-discrimination>, accessed on 14 October 2024.
6 Sinead O’Connor and Helen Liu, ‘Gender bias perpetuation and mitigation in AI technologies: challenges and opportunities’, 39:2045-2057, 2024, <Gender bias perpetuation and mitigation in AI technologies: challenges and opportunities>, accessed on 14 October 2024.
7 Ayesha Nadeem, Olivera Marjanovic and Babak Abedin, ‘Gender bias in AI-based decision-making systems: a systematic literature review’, Australasian Journal of Information Systems, 26, 2022, <Gender bias in AI-based decision-making systems: a systemic literature review> accessed on 14 October 2024.
8 Amit Haim, Alejandro Salinas and Julian Nyarko, ‘What’s in a Name? Auditing Large Language Models for Race and Gender Bias’, 2024, <What’s in a Name? Auditing Large Language Models for Race> accessed on 14 October 2024.
9 Ibid.
10 Ibid.
11 Ibid.
12 Paula Hall and Debbie Ellis, ‘A systemic review of socio-technical gender bias in AI algorithms’, Online Information Review, 47(7), 2023, <A systematic review of socio-technical gender bias in AI algorithms> accessed on 14 October 2024.
13 Youjin Kong, ‘Are “Intersectionally Fair” AI Algorithms Really Fair to Women of Color? A Philosophical Analysis’, Association for Computing Machinery, 2022, <Are “Intersectionally Fair” AI Algorithms Really Fair to Women of Color? A Philosophical Analysis> accessed on 15 October 2024.
14 Ibid.
15 Liaqat Khan, ‘Addressing Gender Inequalities with AI-Driven Policies in Developing Countries’, The Open Science Framework, 2023, <Addressing Gender Inequalities with AI-Driven Policies in Developing Countries>accessed on 14 October 2024.
16 Ibid.
17 Loise Ochanda, Elizabeth Muriithi and Betsy Muriithi, ‘Responsible, ethical and feminist AI for development: Challenges and solutions’, IDRC, 2024, <Responsible, ethical and feminist AI for development: Challenges and solutions> accessed on 14 October 2024.
18 Favour Borokini, Sandra Nabulega and Garnett Achieng’, ‘Engendering AI: A Gender and Ethics Perspective on Artificial Intelligence in Africa’, Pollicy, 2021, <Engendering AI: A Gender and Ethics Perspective on Artificial Intelligence in Africa> accessed on 14 October 2024.
19 Gikunda, K. (2024, January 1). Empowering Africa: An In-depth Exploration of the Adoption of Artificial Intelligence Across the Continent. Cornell University. https://doi.org/10.48550/arxiv.2401.09457 accessed 14 October 2024
20 Townsend, B., Sihlahla, I., Naidoo, M., Naidoo, S., Donnelly, D., & Thaldar, D. (2023, August 24). Mapping the regulatory landscape of AI in healthcare in Africa. Frontiers Media, 14. https://doi.org/10.3389/fphar.2023.1214422 accessed 14 October 2024
21 Chinasa T. Okolo, Kehinde Aruleba, George Obaido (2023). ‘Responsible AI in Africa—Challenges and Opportunities.’ In: Eke, D.O., Wakunuma, K., Akintoye, S. (eds) Responsible AI in Africa. Social and Cultural Studies of Robots and AI. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-031-08215-3_3 accessed 14 October 2024.
22 Ibid.
23 Loise Ochanda, Elizabeth Muriithi and Betsy Muriithi, ‘Responsible, ethical and feminist AI for development: Challenges and solutions’, IDRC, 2024, <Responsible, ethical and feminist AI for development: Challenges and solutions> accessed on 14 October 2024.
24 Ibid.
25 Dickson Ogugu, ‘Catalyzing Artificial Intelligence for Women’s empowerment in Africa’, Lawyers Hub, 2024, <Catalyzing Artificial Intelligence for Women’s empowerment in Africa> accessed on 15 October 2024.
26 Lilian Olivia Orero, ‘Cracking the Gender Equality Code in African AI through the Datasphere’, Datasphere Initiative, 2024, <Cracking the Gender Equality Code in African AI through the Datasphere> accessed on 15 October 2024.
27 Ibid.
28 Ibid.
29 Nagham ElHoussamy, Celine Caira, Conrad Tucker, Johannes Leon Kirnberger, Linda Bonyo, Peter Addo and Rachel Adams, ‘Deliberate, inclusive AI policies to empower women in Africa’, OECD AI Policy Observatory, 2024, <Deliberate, inclusive AI policies to empower women in Africa> accessed on 15 October 2024.
30 Ibid.
31 Ibid.
32 Oarabile Mudongo, ‘Navigating the Intersection of AI, Data Protection, and Gender in Africa: A Feminist Approach’, CIPIT, 2024, <Navigating the Intersection of AI, Data Protection, and Gender in Africa: A Feminist Approach> accessed on 15 October 2024.
33 Ibid.
34 Ibid.
35 African Union, ‘AU Strategy for Gender Equality and Women’s Empowerment’, African Union, 2024, <AU Strategy for Gender Equality and Women’s Empowerment> accessed on 15 October 2024.
36 Mudongo (n23).
37 Liangchen Mei, Xitong Guo, Changrong Du and Kai Cui. “Analyzing the Impact of Gender-Inclusive STEM Curricula on Enhancing Female STEM Literacy: Implications for Social Justice and Economic Equilibrium.” Research and Advances in Education (2023). https://doi.org/10.56397/rae.2023.11.02. accessed 15 October 2024.
38 Chinasa T. Okolo, Kehinde Aruleba, George Obaido (2023). ‘Responsible AI in Africa—Challenges and Opportunities.’ In: Eke, D.O., Wakunuma, K., Akintoye, S. (eds) Responsible AI in Africa. Social and Cultural Studies of Robots and AI. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-031-08215-3_3 accessed 14 October 2024.
39 AI, Gender, & Development in Africa: Feminist Policy Considerations. (2023, January 1). https://www.oii.ox.ac.uk/news-events/reports/ai-gender-development-in-africa-feminist-policy-considerations/ accessed 15 October 2024.
40 Rachel Adams (2022, May 30). AI in Africa: Key Concerns and Policy Considerations for the Future of the Continent. https://afripoli.org/ai-in-africa-key-concerns-and-policy-considerations-for-the-future-of-the-continent accessed 15 October 2024
41 Pollicy, ‘Engendering Artificial Intelligence.’ (2023, January 1). https://pollicy.org/resource/engendering-artificial-intelligence/ accessed 15 October 2024.
42 Klein, L., & D’Ignazio, C. (2024, June 3). ‘Data Feminism for AI.’ , 1989, 100-112. https://doi.org/10.1145/3630106.3658543 accessed 15 October 2024.
43 Diallo, K., Smith, J H., Okolo, C T., Nyamwaya, D., Kgomo, J., & Ngamita, R. (2024, February 29). ‘Case Studies of AI Policy Development in Africa.’ Cornell University. https://doi.org/10.48550/arxiv.2403.14662 accessed 15 October 2024.