Gender stereotyping in generative AI

Although the use of generative AI has significantly improved efficiency and productivity in the creative industry, it has also raised concerns about reinforcing biased worldviews related to gender, caste, ethnicity, geography and other social dimensions. Against this backdrop, this article begins by presenting findings from this writer’s experiments that reveal how generative AI responds to key gender-related prompts. It then reviews past research to explore whether generative AI perpetuates traditional notions of gender inequality and stereotypes, or whether it represents a more progressive shift. The article then analyzes the root causes of biased outputs, and proposes pathways for more equitable, inclusive and socially responsible AI development.

To examine gender bias in generative AI, I conducted a series of prompt-based experiments using a widely-used generative AI tool. When I asked the tool to write a hypothetical story about a nurse, it immediately assigned a female name and used the pronoun “she.” This pattern continued across other professions. Scientist, engineer, and security guard, Army, Police, were consistently given male names and pronouns, while kitchen helpers, dancers and Early Childhood Development (ECD) teachers were presented as female. Even in the health sector, roles like gynecologist were portrayed as female, whereas doctors were more often assigned male or mixed-gender identities.

Next, I tested how the AI assigned roles in hierarchical professional settings. When prompted to generate hypothetical names of CEOs and their secretaries, the AI consistently provided male names for CEOs and female names for secretaries, reinforcing traditional occupational gender roles. And when asked to list 20 fictional nurses, it provided all female names. A prompt for 20 ECD teachers also resulted in exclusively female names. In contrast, prompts for teachers and head teachers produced a mix of male and female names, though still reflecting gendered assumptions depending on the level of authority or setting.

Across multiple attempts, the results were consistent: generative AI tools tend to reflect and reproduce entrenched gender stereotypes. While they may occasionally offer mixed or neutral outputs, the overall trend favors traditional associations between gender and profession. 

The outcome of the experiment aligns closely with findings from a 2024 UNESCO study titled “Challenging Systematic Prejudices: An Investigation into Bias Against Women and Girls in Large Language Models.” The report reveals that generative AI systems consistently exhibit pervasive biases related to gender, sexuality and race. These systems often associate female names with traditional domestic roles, generate negative or harmful content about LGBTIQA+ individuals, and assign stereotypical professions based on gender and ethnicity.

According to the research report entitled  Gender and Ethnicity Representation of University Academics by Generative Artificial Intelligence Using DALL-E 3 by Currie, Hewis and Wheat (2025), published in the Journal of Further and Higher Education, generative AI tools continue to reproduce systemic biases in visual representation. The analysis revealed that 82.2 percent of AI-generated academic characters were male and 94.2 percent were light-skinned. Women, people with darker skin tones and individuals with disabilities were significantly underrepresented.

This apart,  a recent study in Australia titled Gender Bias in Generative Artificial Intelligence Text-to-Image Depiction of Medical Students by Currie, G, Currie, J, Anderson, S, and Hewis, J (2024), published in the Health Education Journal, examined how DALL-E 3 generates images of medical students. Although more than half of Australia’s actual medical students are women, as claimed by the research report, the AI overwhelmingly portrayed men being 92 percent. 

Another study, which asked large language models like ChatGPT and Alpaca to generate recommendation letters for hypothetical employees, found clear gender bias in the language used. Men were often described as “experts” and “thinkers,” while women were labeled with terms like “beauty” and “emotional, the study revealed. These patterns highlight deep-rooted gender stereotypes embedded in AI systems.

A 2025 study published in Computers in Human Behavior: Artificial Humans offers how AI wrongly represents females in healthcare.  The research, conducted by Ho, Hartanto, Koh, and Majeed, revealed that women’s heart disease symptoms are often misdiagnosed or wrongly linked to other conditions, despite being identical to men’s. Diagnostic AI tools also consistently performed better for male patients, resulting in more frequent underdiagnosis and misdiagnosis for women.

Why biased outputs?

The AI and tech industries remain overwhelmingly male-dominated, with women occupying only a small fraction of development roles. This gender imbalance directly influences how AI systems are conceived and built. As a consequence of this, male-centered perspectives and assumptions into the architecture of artificial intelligence are dominant. This apart, there is the lack of robust fairness testing in many AI tools, especially across gender, race and cultural dimensions. 

Another reason is the quality of the data these systems are trained on. Many AI tools, particularly text-to-image models, rely on massive datasets like LAION-5B—scraped from the internet, where misinformation, sexism and xenophobia are widespread. Without meaningful filtering and oversight, these flawed inputs lead to the replication and amplification of harmful stereotypes and discriminatory narratives.

The digital gender divide further deepens these inequities. Women globally—and in countries like Nepal—have less access to digital tools. They are underrepresented in online spaces, and face disproportionate levels of online hate, algorithmic discrimination, and exclusion from the tech workforce. Cultural and social barriers continue to restrict women’s access to AI education and mentorship, limiting their participation in shaping the technology. As of 2018, only 10–15 percent of AI developers in major tech firms were women; by 2022, over 90 percent of developers remained male. Generative AI tools not only inherit these biases from their training data but also reinforce them through constant user interactions. For example, when prompted about leadership, these systems often emphasize male figures and valorize stereotypically masculine traits like dominance and risk-taking. This happens because the AI reflects dominant cultural narratives found in the training data. Furthermore,  user prompts and feedback—often unconsciously reinforcing existing norms—create a feedback loop that hardens these gendered patterns over time.

The way forward 

In conclusion, as generative AI becomes more powerful and widespread, it is essential that we shape its development in ways that promote fairness, inclusion and accountability. This means going beyond technical solutions and embracing a people-centered approach using diverse and representative data, ensuring transparency in how AI systems work, and involving voices from historically marginalized communities in every stage of design and decision-making. Strong ethical and human rights standards must guide AI governance, with clear oversight and accountability mechanisms in place. If developed responsibly, AI has the potential not only to avoid reinforcing existing inequalities, but also to help build a more just and equitable digital future for all.

A road like Nepal: A journey through why nations fail

My trip to Muktinath, a sacred temple in Nepal’s Mustang district, began as a spiritual  pilgrimage. I expected silence, mountains and maybe some personal clarity. What I didn’t  expect was that the road itself—the actual journey—would teach me something deeper: why nations like Nepal struggle, not because of poverty or geography, but because of  broken systems. The Himalayas were everything I hoped for. Vast, ancient, silent. The  mountains don’t speak, but they say everything. In that silence, something inside you  wakes up. You feel tiny—but not in a diminished way. You feel connected, humbled, part of  something timeless. 

And then, the road reminds you: you’re still in Nepal. 

At first, everything was smooth. Well-paved stretches give you a sense of order, of progress.  Then suddenly—no warning—dust, potholes, mud, cliffs. No signs. No explanation. Just a sharp jolt. That’s when it hit me: this road is Nepal. Not just physically, but politically and  economically. It reflects how the country moves. Or fails to move. 

Economists Daron Acemoglu and James A Robinson, in their book Why Nations Fail, say  that nations don’t collapse because they’re poor or small—they fall when their institutions  become extractive. That means systems designed not to serve everyone, but to benefit a  small elite. When power is centralized, unaccountable and unresponsive to the people,  things fall apart. Just like the road. That road had moments of beauty—and then chaos. Like  when a traffic jam would appear out of nowhere. No rules, no traffic police. Just honking,  pushing and disorder. Yet somehow, people moved. It was dysfunctional, but it  functioned. That’s Nepal. A country where people no longer expect the system to help—but  find ways to survive anyway. 

Our driver embodied that spirit. He was fearless, navigating landslides and blind turns like a local James Bond. I was terrified. “Why are you scared?” he said. “There’s nothing to be  scared of.” It wasn’t bravery, it was normal for him. Because in Nepal, danger isn’t an  emergency. It’s routine. At one point, we passed a fresh landslide where the road had  barely been cleared. No warning signs. Just a man standing in the dust, motioning to  drivers. No uniform, no authority, just someone stepping in where the state had stepped  out. That moment stuck with me. In a nation where public services falter, ordinary people fill the void. Not because they have to—but because they must. 

And this is the tragedy: people become excellent at surviving systems that should have  protected them in the first place. 

Nepal’s economy feels just like that road. It’s moving—but always at risk. You can plan but never predict. And yet, life continues. People open shops, raise families, guide tourists, offer tea to strangers. They trust not in government, but in each other. That kind of social  capital is rare—and powerful. On those roads, I saw something remarkable: trust among  strangers. No road signs. No clear rules. But still, drivers cooperated. Because they had to.  That trust wasn’t built by policy. It came from culture. From the deep understanding that if people don’t care for each other, no one else will. 

But culture isn’t enough to build a country. Why Nations Fail makes it clear: without inclusive institutions—where opportunity is open to all, leadership is accountable, and  policies are shaped by participation—no amount of individual effort can fix systemic collapse. When policies are made by people who never walk the road, they forget where it  leads. I couldn’t help but ask: how often do our leaders walk these roads themselves? Do they feel the same jolts? Do they see the villagers’ patching holes with rocks? Or the  mothers selling noodles near construction dust while their kids play in broken corners of  concrete? Or do they see only blueprints and budgets? 

Nepal’s institutions feel just like those road bumps—sudden, unexplained and dangerous.  Too often, leaders govern without grounding. They change policies without clarity. They  promise without delivery. And still, people adapt. They move forward because it’s the only direction available. 

At Muktinath, I finally reached stillness again. Cold wind, ancient stones, sacred silence. You don’t need to understand everything to feel something shift inside. You just breathe.  And for a moment, it’s enough. But when I looked back at the journey, the literal road and  the metaphor it became, I couldn’t ignore the deeper lesson. Nepal doesn’t lack potential. It doesn’t lack spirit, creativity or community. What it lacks is leadership that walks the same road the people do. Institutions that work for everyone. Roads that are built not just  to impress, but to endure. 

Acemoglu and Robinson remind us that even countries that start the same—like North and South Korea—can end up in vastly different places if one builds extractive institutions and  the other builds inclusive ones. One stagnates, the other grows. It’s not fate. It’s a choice. Still, I believe change is possible. I see it in the eyes of young Nepalis—those who question, who leave and return, who imagine something better. I see it in those who fix what isn’t  their job to fix. In communities that cooperate even when the state fails. 

So yes, the mountains healed me. But the road taught me the truth. 

Nations don’t fail because their people are weak. They fail when their systems are weak. And  unless we rebuild those systems—with inclusion, accountability, and connection—we’ll  keep driving blind, hoping to avoid the next collapse. 

And still, despite it all, Nepal moves forward. Bumpy. Risky. Beautiful. Still going.

 

Why social media bill is deeply problematic

In recent years, Nepal has witnessed exponential growth in the use of various social media platforms. The most popular social media platforms include Facebook, X (formerly Twitter), TikTok, Instagram, Snapchat, Instagram and LinkedIn. Among these, Facebook maintains strong dominance over the Nepali social media landscape. According to data from the NapoleonCat, there were 16,479,500 Facebook users in Nepal as of Aug 2024, accounting for 51.6 percent of the population. Of these, 55.9 percent were male.

However, Facebook’s user base is gradually declining as adult users shift toward TikTok and GenZ increasingly favors platforms like TikTok and Instagram. Meanwhile, X is gaining popularity, particularly among news-savvy and politically-engaged users. But it has also become a tool for political propaganda, with ‘cyber armies’ from various political parties engaging in online smear campaigns and character assassination. This toxic environment is pushing intellectuals and thoughtful users away from the platform.

LinkedIn, on the other hand, is growing steadily in popularity among professionals seeking networking and career development opportunities. The spread of misinformation, disinformation, hate speech and cybercrime has become a pressing issue globally. Many countries are grappling with how to regulate social media in ways that respect freedom of speech while addressing these concerns. While many European nations have developed balanced approaches, several South Asian countries, including Bangladesh, are using social media regulations to suppress political opposition. 

Nepal is no exception. For over 15 years, authorities have misused Section 47 of the Electronic Transaction Act to arrest journalists and silence critics. Recently, this trend has intensified, with ruling party leaders increasingly targeting those who voice dissent. Criticisms of the government or political parties are often misclassified as fake news or hate speech, even when it clearly is not. This raises concerns that new laws may also be exploited for similar purposes.

In February, the government introduced the Social Media Act Bill in the National Assembly, the upper house of the country’s federal parliament. The Bill has sparked public debate due to several fundamental flaws. The first and foremost is the flawed legislative process itself: government officials involved in consultations have adopted a narrow, bureaucratic perspective.


There is a belief within bureaucracy that regulation can be achieved by simply creating a department. This approach fails to recognize that regulating digital platforms is far more complex than overseeing traditional media like radio, television or print which are historically governed by the Ministry of Communication and Information Technology and its subordinate bodies.

Social media regulation is multi-faceted and far-reaching. No state agency can realistically monitor an entire population. Yet the ministry appears to consult only with stakeholders like the Federation of Nepalese Journalists (FNJ), organizations of journalists affiliated with major political parties and a handful of non-governmental organizations close to the ruling parties. Independent academics and experts outside the political sphere are largely excluded from the process.

This issue is not limited to social media bills; similar problems exist in other media-related legislation. While parliament has the authority to correct fundamental flaws, lawmakers often lack necessary expertise. Many rely on briefings from NGOs. This limited input, combined with their often weak academic backgrounds, proves insufficient. Lawmakers frequently raise concerns merely to appease journalists rather than engaging meaningfully in the legislative process.

From top to bottom, the bill is riddled with problems. The preamble fails to affirm commitment to international treaties and conventions and other legal instruments to which Nepal is a party. The country has signed international treaties and conventions expressing its full commitment to upholding freedom of speech and expression. But the principles laid out by those international conventions often clash with the narrow understanding held by many Nepali politicians who view criticism as a threat rather than a democratic right.

 

The 2015 constitution, like its previous versions, contains progressive provisions when it comes to safeguarding freedom of speech and expression. The draft briefly touches the constitutional provision of freedom of speech and expression but remains silent about international commitment. Regarding the international part, the bill states that as other countries are formulating the news, Nepal also needs to formulate the law which is a misrepresentation of Nepal’s international commitments.  The Supreme Court has also delivered landmark verdicts upholding these rights.

However, recent rulings by lower courts appear to contradict the precedents set by the apex court. These decisions only briefly acknowledge the constitutional guarantee of free speech, signaling a shift away from the earlier commitment to protecting this fundamental right.

 

The Social Media Bill reflects this trend. It fails to clearly state that its purpose is to strengthen freedom of speech and expressions. Instead, it focuses more heavily on regulating social media users, given the impression that its main intent is to restrict, rather than protect, free expression.  

Undeniably, countries across the world are moving quickly to regulate social media to mitigate its negative impacts on society and democracy. But such efforts must never come at the cost of fundamental freedoms, especially freedom of speech, expression and press. Nepal should study how other nations have successfully enacted social media without undermining democratic rights.

Before drafting the bill, the government should have consulted with representatives of major social media companies. Content regulation and moderation are core to the functioning of these platforms, and without their cooperation, any regulatory framework is likely to fail. In this context, Nepal’s top political leadership should use its diplomatic and political channels to engage with these companies. For instance, a few months ago, there was communication between Prime Minister KP Sharma Oli and Elon Musk on certain issues. This shows such outreach is possible.

Regrettably, the ministry issued a public notice demanding that social media giants register in Nepal and obtain licenses. It even set a deadline that went ignored. The ministry also threatened to shut down social media platforms, a move widely seen as immature and impractical. A more constructive approach would have been to initiate dialogue, revise the proposed provisions in consultation with these companies and then develop a feasible licensing system.

As it stands, the bill grants sweeping powers to a government-formed department to oversee all social media-related issues. Given the scale and complexity of regulating digital platforms, this is highly problematic. What’s needed is an independent, empowered commission—free from political interference, bureaucratic control, corporate influence and other vested interests. Such a body should be authorized to work directly with social media companies to ensure effective and fair regulation.

The current draft appears to be designed with the aim of removing political content critical of ruling parties. In recent years, there has been a clear trend of political parties using state agencies to target and punish critics of the government and party leadership. If passed without meaningful amendments, the bill risks becoming an extension of the Cyber Bureau, an institution that has already been misused for political purposes.

One positive aspect of the bill is its commitment to launching a large-scale awareness campaign on the responsible use of social media. It proposes to raise public awareness through publications, broadcasts, websites, seminars, public service announcements and dialogues. However, the government does not need to wait for the bill to be passed to begin this vital initiative.

In conclusion, the government must take proactive steps to address the fundamental flaws in the draft bill as it is evident that the agencies involved have failed to adequately study international best practices or documents prepared by global institutions.

Why social media bill is deeply problematic

In recent years, Nepal has witnessed exponential growth in the use of various social media platforms. The most popular social media platforms include Facebook, X (formerly Twitter), TikTok, Instagram, Snapchat, Instagram and LinkedIn. Among these, Facebook maintains strong dominance over the Nepali social media landscape. According to data from the NapoleonCat, there were 16,479,500 Facebook users in Nepal as of Aug 2024, accounting for 51.6 percent of the population. Of these, 55.9 percent were male. 

However, Facebook’s user base is gradually declining as adult users shift toward TikTok and GenZ increasingly favors platforms like TikTok and Instagram. Meanwhile, X is gaining popularity, particularly among news-savvy and politically-engaged users. But it has also become a tool for political propaganda, with ‘cyber armies’ from various political parties engaging in online smear campaigns and character assassination. This toxic environment is pushing intellectuals and thoughtful users away from the platform. 

LinkedIn, on the other hand, is growing steadily in popularity among professionals seeking networking and career development opportunities. The spread of misinformation, disinformation, hate speech and cybercrime has become a pressing issue globally. Many countries are grappling with how to regulate social media in ways that respect freedom of speech while addressing these concerns. While many European nations have developed balanced approaches, several South Asian countries, including Bangladesh, are using social media regulations to suppress political opposition.  

Nepal is no exception. For over 15 years, authorities have misused Section 47 of the Electronic Transaction Act to arrest journalists and silence critics. Recently, this trend has intensified, with ruling party leaders increasingly targeting those who voice dissent. Criticisms of the government or political parties are often misclassified as fake news or hate speech, even when it clearly is not. This raises concerns that new laws may also be exploited for similar purposes. 

In February, the government introduced the Social Media Act Bill in the National Assembly, the upper house of the country’s federal parliament. The Bill has sparked public debate due to several fundamental flaws. The first and foremost is the flawed legislative process itself: government officials involved in consultations have adopted a narrow, bureaucratic perspective.

There is a belief within bureaucracy that regulation can be achieved by simply creating a department. This approach fails to recognize that regulating digital platforms is far more complex than overseeing traditional media like radio, television or print which are historically governed by the Ministry of Communication and Information Technology and its subordinate bodies.

Social media regulation is multi-faceted and far-reaching. No state agency can realistically monitor an entire population. Yet the ministry appears to consult only with stakeholders like the Federation of Nepalese Journalists (FNJ), organizations of journalists affiliated with major political parties and a handful of non-governmental organizations close to the ruling parties. Independent academics and experts outside the political sphere are largely excluded from the process.

This issue is not limited to social media bills; similar problems exist in other media-related legislation. While parliament has the authority to correct fundamental flaws, lawmakers often lack necessary expertise. Many rely on briefings from NGOs. This limited input, combined with their often weak academic backgrounds, proves insufficient. Lawmakers frequently raise concerns merely to appease journalists rather than engaging meaningfully in the legislative process.

From top to bottom, the bill is riddled with problems. The preamble fails to affirm commitment to international treaties and conventions and other legal instruments to which Nepal is a party. The country has signed international treaties and conventions expressing its full commitment to upholding freedom of speech and expression. But the principles laid out by those international conventions often clash with the narrow understanding held by many Nepali politicians who view criticism as a threat rather than a democratic right.

The 2015 constitution, like its previous versions, contains progressive provisions when it comes to safeguarding freedom of speech and expression. The draft briefly touches the constitutional provision of freedom of speech and expression but remains silent about international commitment. Regarding the international part, the bill states that as other countries are formulating the news, Nepal also needs to formulate the law which is a misrepresentation of Nepal’s international commitments.  The Supreme Court has also delivered landmark verdicts upholding these rights.

However, recent rulings by lower courts appear to contradict the precedents set by the apex court. These decisions only briefly acknowledge the constitutional guarantee of free speech, signaling a shift away from the earlier commitment to protecting this fundamental right.

The Social Media Bill reflects this trend. It fails to clearly state that its purpose is to strengthen freedom of speech and expressions. Instead, it focuses more heavily on regulating social media users, given the impression that its main intent is to restrict, rather than protect, free expression.  

Undeniably, countries across the world are moving quickly to regulate social media to mitigate its negative impacts on society and democracy. But such efforts must never come at the cost of fundamental freedoms, especially freedom of speech, expression and press. Nepal should study how other nations have successfully enacted social media without undermining democratic rights.

Before drafting the bill, the government should have consulted with representatives of major social media companies. Content regulation and moderation are core to the functioning of these platforms, and without their cooperation, any regulatory framework is likely to fail. In this context, Nepal’s top political leadership should use its diplomatic and political channels to engage with these companies. For instance, a few months ago, there was communication between Prime Minister KP Sharma Oli and Elon Musk on certain issues. This shows such outreach is possible.

Regrettably, the ministry issued a public notice demanding that social media giants register in Nepal and obtain licenses. It even set a deadline that went ignored. The ministry also threatened to shut down social media platforms, a move widely seen as immature and impractical. A more constructive approach would have been to initiate dialogue, revise the proposed provisions in consultation with these companies and then develop a feasible licensing system.

As it stands, the bill grants sweeping powers to a government-formed department to oversee all social media-related issues. Given the scale and complexity of regulating digital platforms, this is highly problematic. What’s needed is an independent, empowered commission—free from political interference, bureaucratic control, corporate influence and other vested interests. Such a body should be authorized to work directly with social media companies to ensure effective and fair regulation.

The current draft appears to be designed with the aim of removing political content critical of ruling parties. In recent years, there has been a clear trend of political parties using state agencies to target and punish critics of the government and party leadership. If passed without meaningful amendments, the bill risks becoming an extension of the Cyber Bureau, an institution that has already been misused for political purposes.

One positive aspect of the bill is its commitment to launching a large-scale awareness campaign on the responsible use of social media. It proposes to raise public awareness through publications, broadcasts, websites, seminars, public service announcements and dialogues. However, the government does not need to wait for the bill to be passed to begin this vital initiative.

In conclusion, the government must take proactive steps to address the fundamental flaws in the draft bill as it is evident that the agencies involved have failed to adequately study international best practices or documents prepared by global institutions.