March 2010 April 2010 May 2010 June 2010 July 2010
August 2010
September 2010 October 2010
November 2010
December 2010 January 2011 February 2011 March 2011 April 2011 May 2011 June 2011 July 2011 August 2011 September 2011 October 2011 November 2011 December 2011 January 2012 February 2012 March 2012 April 2012 May 2012 June 2012 July 2012 August 2012 September 2012 October 2012 November 2012 December 2012 January 2013 February 2013 March 2013 April 2013 May 2013 June 2013 July 2013 August 2013 September 2013 October 2013 November 2013 December 2013 January 2014 February 2014 March 2014 April 2014 May 2014 June 2014 July 2014 August 2014 September 2014 October 2014 November 2014 December 2014 January 2015 February 2015 March 2015 April 2015 May 2015 June 2015 July 2015 August 2015 September 2015 October 2015 November 2015 December 2015 January 2016 February 2016 March 2016 April 2016 May 2016 June 2016 July 2016 August 2016 September 2016 October 2016 November 2016 December 2016 January 2017 February 2017 March 2017 April 2017 May 2017 June 2017 July 2017 August 2017 September 2017 October 2017 November 2017 December 2017 January 2018 February 2018 March 2018 April 2018 May 2018 June 2018 July 2018 August 2018 September 2018 October 2018 November 2018 December 2018 January 2019 February 2019 March 2019 April 2019 May 2019 June 2019 July 2019 August 2019 September 2019 October 2019 November 2019 December 2019 January 2020 February 2020 March 2020 April 2020 May 2020 June 2020 July 2020 August 2020 September 2020 October 2020 November 2020 December 2020 January 2021 February 2021 March 2021 April 2021 May 2021 June 2021 July 2021 August 2021 September 2021 October 2021 November 2021 December 2021 January 2022 February 2022 March 2022 April 2022 May 2022 June 2022 July 2022 August 2022 September 2022 October 2022 November 2022 December 2022 January 2023 February 2023 March 2023 April 2023 May 2023 June 2023 July 2023 August 2023 September 2023 October 2023 November 2023 December 2023 January 2024 February 2024 March 2024 April 2024 May 2024 June 2024 July 2024 August 2024 September 2024 October 2024
1 2 3 4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
News Every Day |

Online spaces are rife with toxicity. Well-designed AI tools can help clean them up

Imagine scrolling through social media or playing an online game, only to be interrupted by insulting and harassing comments. What if an artificial intelligence (AI) tool stepped in to remove the abuse before you even saw it?

This isn’t science fiction. Commercial AI tools like ToxMod and Bodyguard.ai are already used to monitor interactions in real time across social media and gaming platforms. They can detect and respond to toxic behaviour.

The idea of an all-seeing AI monitoring our every move might sound Orwellian, but these tools could be key to making the internet a safer place.

However, for AI moderation to succeed, it needs to prioritise values like privacy, transparency, explainability and fairness. So can we ensure AI can be trusted to make our online spaces better? Our two recent research projects into AI-driven moderation show this can be done – with more work ahead of us.

Negativity thrives online

Online toxicity is a growing problem. Nearly half of young Australians have experienced some form of negative online interaction, with almost one in five experiencing cyberbullying.

Whether it’s a single offensive comment or a sustained slew of harassment, such harmful interactions are part of daily life for many internet users.

The severity of online toxicity is one reason the Australian government has proposed banning social media for children under 14.

But this approach fails to fully address a core underlying problem: the design of online platforms and moderation tools. We need to rethink how online platforms are designed to minimize harmful interactions for all users, not just children.

Unfortunately, many tech giants with power over our online activities have been slow to take on more responsibility, leaving significant gaps in moderation and safety measures.

This is where proactive AI moderation offers the chance to create safer, more respectful online spaces. But can AI truly deliver on this promise? Here’s what we found.

‘Havoc’ in online multiplayer games

In our Games and Artificial Intelligence Moderation (GAIM) Project, we set out to understand the ethical opportunities and pitfalls of AI-driven moderation in online multiplayer games. We conducted 26 in-depth interviews with players and industry professionals to find out how they use and think about AI in these spaces.

Interviewees saw AI as a necessary tool to make games safer and combat the “havoc” caused by toxicity. With millions of players, human moderators can’t catch everything. But an untiring and proactive AI can pick up what humans miss, helping reduce the stress and burnout associated with moderating toxic messages.

But many players also expressed confusion about the use of AI moderation. They didn’t understand why they received account suspensions, bans and other punishments, and were often left frustrated that their own reports of toxic behavior seemed to be lost to the void, unanswered.

Participants were especially worried about privacy in situations where AI is used to moderate voice chat in games. One player exclaimed: “my god, is that even legal?” It is – and it’s already happening in popular online games such as Call of Duty.

Our study revealed there’s tremendous positive potential for AI moderation. However, games and social media companies will need to do a lot more work to make these systems transparent, empowering and trustworthy.

Right now, AI moderation is seen to operate much like a police officer in an opaque justice system. What if AI instead took the form of a teacher, guardian, or upstander – educating, empowering or supporting users?

Enter AI Ally

This is where our second project AI Ally comes in, an initiative funded by the eSafety Commissioner. In response to high rates of tech-based gendered violence in Australia, we are co-designing an AI tool to support girls, women and gender-diverse individuals in navigating safer online spaces.

We surveyed 230 people from these groups, and found that 44% of our respondents “often” or “always” experienced gendered harassment on at least one social media platform. It happened most frequently in response to everyday online activities like posting photos of themselves, particularly in the form of sexist comments.

Interestingly, our respondents reported that documenting instances of online abuse was especially useful when they wanted to support other targets of harassment, such as by gathering screenshots of abusive comments. But only a few of those surveyed did this in practice. Understandably, many also feared for their own safety should they intervene by defending someone or even speaking up in a public comment thread.

These are worrying findings. In response, we are designing our AI tool as an optional dashboard that detects and documents toxic comments. To help guide us in the design process, we have created a set of “personas” that capture some of our target users, inspired by our survey respondents.

Some of the user ‘personas’ guiding the development of the AI Ally tool. Ren Galwey/Research Rendered

We allow users to make their own decisions about whether to filter, flag, block or report harassment in efficient ways that align with their own preferences and personal safety.

In this way, we hope to use AI to offer young people easy-to-access support in managing online safety while offering autonomy and a sense of empowerment.

We can all play a role

AI Ally shows we can use AI to help make online spaces safer without having to sacrifice values like transparency and user control. But there is much more to be done.

Other, similar initiatives include Harassment Manager, which was designed to identify and document abuse on Twitter (now X), and HeartMob, a community where targets of online harassment can seek support.

Until ethical AI practices are more widely adopted, users must stay informed. Before joining a platform, check if they are transparent about their policies and offer user control over moderation settings.

The internet connects us to resources, work, play and community. Everyone has the right to access these benefits without harassment and abuse. It’s up to all of us to be proactive and advocate for smarter, more ethical technology that protects our values and our digital spaces.


The AI Ally team consists of Dr Mahli-Ann Butt, Dr Lucy Sparrow, Dr Eduardo Oliveira, Ren Galwey, Dahlia Jovic, Sable Wang-Wills, Yige Song and Maddy Weeks.

Lucy Sparrow, Lecturer in Human-Computer Interaction, The University of Melbourne; Eduardo Oliveira, Senior Lecturer in Software Engineering, The University of Melbourne, and Mahli-Ann Butt, Lecturer, Cultural Studies, The University of Melbourne

This article is republished from The Conversation under a Creative Commons license. Read the original article.

Москва

Россияне раскрыли, сколько готовы заплатить за частного врача

Game on: Automakers expand video entertainment options in vehicles

3 Negroni variations to try this fall

Protect and Enhance Your Vehicle with Paint Protection Film and Ceramic Coating from Tintex

Turkish Police arrest 14 Afghan refugees

Ria.city






Read also

Real Men Aren’t Afraid of Powerful Women

Clear and mild, localised coastal clouds

Horror moment desperate armed guards on Brit ship open fire on bomb-laden Houthi drone boat before it smashes into hull

News, articles, comments, with a minute-by-minute update, now on Today24.pro

News Every Day

Game on: Automakers expand video entertainment options in vehicles

Today24.pro — latest news 24/7. You can add your news instantly now — here


News Every Day

Turkish Police arrest 14 Afghan refugees



Sports today


Новости тенниса
ATP

Медведев пожаловался на применение Hawk Eye на турнире ATP в Пекине



Спорт в России и мире
Москва

«Динамо» Москва — «Трактор» — 1:4. Видеообзор матча КХЛ



All sports news today





Sports in Russia today

Москва

Mash: футболиста Александра Мостового экстренно прооперировали в Москве


Новости России

Game News

Destiny 2 is adding new maps and factions to the superb Onslaught mode next week, but Bungie confirms no new 'shiny' weapons


Russian.city


ATP

Медведев пожаловался на применение Hawk Eye на турнире ATP в Пекине


Губернаторы России
Байконур

Сотрудники Росгвардии, дислоцированные на территории комплекса «Байконур», приняли участие в товарищеском матче по мини-футболу


В Новокузнецке пройдет международный конкурс искусств «МОЯ ЗВЕЗДА» им. А.И. Ленского

Свыше 6,5 тысячи жителей Москвы и Московской области получили справки о статусе предпенсионера в клиентских службах регионального Отделения СФР и МФЦ

Социальный фонд оказывает помощь эвакуированным жителям Курской области

На 90-м году жизни умерла художник-мультипликатор Марина Восканьянц


Большой театр начнет продавать билеты по паспорту

На создание Дома музыки С.В. Рахманинова в Новгороде было выделено 170 млн рублей

«Зато в одном списке с Metallica». Соцсети о новом запрете России для артистов

Концерт классической музыки пройдет во дворце культуры в Балашихе 4 октября


Медведев пожаловался на применение Hawk Eye на турнире ATP в Пекине

Теннисист Рублев: после US Open мне грозила ампутация

Медведев проиграл Алькарасу в полуфинале турнира ATP в Пекине

Рублёв признался, что мог завершить сезон после операции перед турниром ATP в Пекине



С начала 2024 года более 2,5 тысячи многодетных мам в Московском регионе досрочно вышли на пенсию

Свыше 6,5 тысячи жителей Москвы и Московской области получили справки о статусе предпенсионера в клиентских службах регионального Отделения СФР и МФЦ

Инновационная экосистема Китая: возможности для роста компаний

Прокуратура: Блогер Чекалина и ее партнеры обвинены в выводе 250 млн рублей по подложным документам


Лавров проведет переговоры с главами МИД Абхазии и Южной Осетии

«Это крик души»: Нюша спела о сильных девочках

Разработан 1-й в мире косметический материал, состоящий на 100% из активных компонентов

«Зенит» объявил стартовый состав на матч Кубка России против «Акрона»


Инспекторы МАДИ зафиксировали более 45 тысяч случаев нарушения парковки

Эксперты дали россиянам ответ, когда нужно менять резину на зимнюю

Пробка на восемь километров образовалась на Ярославском шоссе из-за ДТП

Глава Минпромторга назвал три проблемы роботов в России



Путин в России и мире






Персональные новости Russian.city
Сергей Брановицкий

Дистрибьюция Музыки. Дистрибьюция музыки в ВК Яндекс музыка дистрибьюция. Цифровая дистрибьюция музыка. Дистрибьюция музыки под ключ.



News Every Day

Game on: Automakers expand video entertainment options in vehicles




Friends of Today24

Музыкальные новости

Персональные новости