We in Telegram
Add news
March 2010 April 2010 May 2010 June 2010 July 2010
August 2010
September 2010 October 2010
November 2010
December 2010
January 2011
February 2011 March 2011 April 2011 May 2011 June 2011 July 2011 August 2011 September 2011 October 2011 November 2011 December 2011 January 2012 February 2012 March 2012 April 2012 May 2012 June 2012 July 2012 August 2012 September 2012 October 2012 November 2012 December 2012 January 2013 February 2013 March 2013 April 2013 May 2013 June 2013 July 2013 August 2013 September 2013 October 2013 November 2013 December 2013 January 2014 February 2014 March 2014 April 2014 May 2014 June 2014 July 2014 August 2014 September 2014 October 2014 November 2014 December 2014 January 2015 February 2015 March 2015 April 2015 May 2015 June 2015 July 2015 August 2015 September 2015 October 2015 November 2015 December 2015 January 2016 February 2016 March 2016 April 2016 May 2016 June 2016 July 2016 August 2016 September 2016 October 2016 November 2016 December 2016 January 2017 February 2017 March 2017 April 2017 May 2017 June 2017 July 2017 August 2017 September 2017 October 2017 November 2017 December 2017 January 2018 February 2018 March 2018 April 2018 May 2018 June 2018 July 2018 August 2018 September 2018 October 2018 November 2018 December 2018 January 2019 February 2019 March 2019 April 2019 May 2019 June 2019 July 2019 August 2019 September 2019 October 2019 November 2019 December 2019 January 2020 February 2020 March 2020 April 2020 May 2020 June 2020 July 2020 August 2020 September 2020 October 2020 November 2020 December 2020 January 2021 February 2021 March 2021 April 2021 May 2021 June 2021 July 2021 August 2021 September 2021 October 2021 November 2021 December 2021 January 2022 February 2022 March 2022 April 2022 May 2022 June 2022 July 2022 August 2022 September 2022 October 2022 November 2022 December 2022 January 2023 February 2023 March 2023 April 2023 May 2023 June 2023 July 2023 August 2023 September 2023 October 2023 November 2023 December 2023 January 2024 February 2024
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
News Every Day |

Biased GPT? Singapore builds AI model to ‘represent’ Southeast Asians

SINGAPORE – Like millions worldwide, Southeast Asians have been trying out large language models such as Meta’s Llama 2 and Mistral AI – but in their native Bahasa Indonesia or Thai. The result has usually been gibberish in English.

This leaves them at a disadvantage, tech experts warn, as generative artificial intelligence transforms education, work and governance worldwide.

A Singapore government-led initiative aims to correct the imbalance with a Southeast Asian LLM, the first in a family of models named SEA-LION – Southeast Asian Languages in One Network – trained in the region’s languages and cultural norms.

Trained on data in 11 Southeast Asian languages including Vietnamese, Thai and Bahasa Indonesia, the open-sourced model is a cheaper and more efficient option for the region’s businesses, governments and academia, said Leslie Teo at AI Singapore.

“Do we want to force every person in Southeast Asia to adapt to the machine, or do we want to make it more accessible so people in the region can make full use of the technology without having to be an English speaker?” he said.

“We are not trying to compete with the big LLMs; we are trying to complement them, so there can be better representation of us,” Teo, senior director for AI products, told the Thomson Reuters Foundation.

There are over 7,000 languages spoken worldwide. Yet LLMs including Open AI’s GPT-4 and Meta’s Llama 2 that are used to build AI systems such as chatbots and other tools, have largely been developed for, and are trained on, the English language.

Governments and tech firms are trying to bridge this gap, with India creating datasets in local languages, an LLM in the United Arab Emirates powering generative AI tools in Arabic, and AI models in China, Japan and Vietnam in local languages.

These models can help local populations participate more equitably in the global AI economy that is largely dominated by big tech firms, said Nuurrianti Jalli, an assistant professor at Oklahoma State University’s school of communications.

“Regional LLMs are also needed because they support technology self-reliance,” she said. “Less reliance on Western LLMs could provide better privacy for local populations, and also align better with national or regional interest.”

Verify and filter

Multilingual language models that are trained on text from several languages at once, can infer semantic and grammatical connections between high resource languages that have more data, and low resource languages, researchers say.

These models can be used in a variety of applications from translation to customer-service chatbots, to content moderation on social media platforms that have struggled to identify hate speech in low resource languages such as Burmese or Amharic.

About 13% of SEA-LION’s data is sourced from Southeast Asian languages – more than any other major LLM, said Teo. More than 9% of its data is from Chinese text, and about 63% from English.

Multilingual language models often train on translated text and other poor quality data that may have errors, so AI Singapore is “careful” about the data used in training SEA-LION, Teo said in his office at the National University of Singapore.

“The age of pristine data has passed – a lot of the stuff on the internet now is material that is generated by LLMs, so we need to verify and filter,” he said.

“We cannot be perfect, but we also cannot take out everything we consider to be bad,” he added.

More governments are contributing data, and businesses are testing SEA-LION, which due to its smaller size can be deployed faster and is cheaper to fine-tune and adopt, Teo said.

At Indonesian e-commerce company Tokopedia, a majority of customer interactions is in Bahasa Indonesia, so models “with that local fluency will enhance our ability to connect with customers and improve their experiences,” said Paul Condylis, Tokopedia’s associate vice president of data science.

Bias in the data

As more countries and regions build their own LLMs, digital and human rights experts fret that they will reproduce only the dominant views expressed online, which can be particularly problematic in nations with authoritarian governments or strict media censorship, or those lacking a strong civil society.

Chinese social media platforms, for example, censor references to the Tiananmen Square uprising and criticism of the government, while several Southeast Asian nations have enacted laws to curb content that authorities deem as misleading.

“Training models on such data risks perpetuating biased, prejudiced, incomplete and even misleading narratives,” said Jalli.

“The models may fail to surface important socio-political issues like human rights abuse, corruption, or valid criticism of political powers,” she said.

In response to a query on Indonesian former president Suharto, for example, Llama 2 and GPT-4 mentioned his spotty human rights record, while SEA-LION’s response focused largely on his achievements.

If a model is only trained on favorable articles about a government, then the model is “likely to adopt a worldview where the government is wholly positive and leave behind dissenting viewpoints,” said Aliya Bhatia, a policy analyst at the Center for Democracy & Technology, a U.S. non-profit.

“Regional LLMs may better reflect the linguistic and cultural nuances of local language speakers, but they may also have less information about the world in general,” she added.

“There is a real risk of government-backed models instilling a revisionist view of history and undermining democratic values.”

But the alternative – relying entirely on Western LLMs with “disproportionately large influences” from wealthy, liberal, western democracies – means perpetuating different biases related to cultural values, political beliefs and social norms, according to AI Singapore.

“These LLMs have a very particular West Coast American bias – they are very woke. They do not represent us,” said Teo.

“We are not saying ours is the only perspective – we are just trying to rebalance it.” – Rappler.com


Число посетителей парков Москвы за 10 лет увеличилось в четыре раза

Stunning Photo Collection of OLD MONEY - COLORIZED

Beautiful Outdoor Garden Furniture, Garden Library Interior, Hidden Book Nook Garden Design

1960s USA - Real Street Scenes of Vintage America - Colorized

Amsterdam Stunning Sunny Hour Winter 2024 Amsterdam Walking Tour 4K


Read also

Beatle George Harrison, Eric Clapton's love triangle letters with Pattie Boyd to be auctioned

Carville says donors to RNC, Trump 'begging to be stolen from'

Federal judge rules proxy votes can't count toward House quorum

News, articles, comments, with a minute-by-minute update, now on Today24.pro

News Every Day

Top 10 Mystery TV Series of 2023

Today24.pro — latest news 24/7. You can add your news instantly now — here

News Every Day

1960s USA - Real Street Scenes of Vintage America - Colorized

Sports today

Новости тенниса
Анна Калинская

Селиваненко считает, что Калинской для победы в финале не хватило опыта

Спорт в России и мире

Гости Всемирного Фестиваля молодежи примут участие в шахматном турнире Mendeleev Chess

All sports news today

Sports in Russia today


Гости Всемирного Фестиваля молодежи примут участие в шахматном турнире Mendeleev Chess

Новости России

Game News

Мафия-НН: Вечер пролетел, окутанный пламенем веселья и непредсказуемости.



Шапки женские зимние на Wildberries — скидки от 398 руб. (на новые оттенки)

Губернаторы России

Шапки женские зимние на Wildberries — скидки от 398 руб. (на новые оттенки)


«Мне повезло»: как Деревянко заработал на квартиру в центре Москвы

За козу ответишь. Как работается людям, которые кормят животных в зоопарке?

Предприятие Роскосмоса поставит трамваи в Хабаровск

Шнуров предложил Жукову отбирать участников “Новой Фабрики звезд” на боксерском ринге

Арбенина возмутилась отменой концертов во Владивостоке и на Сахалине

Рэпер Баста выступит в Кемерове 26 апреля

Шнуров предложил Жукову отбирать участников “Новой Фабрики звезд” на боксерском ринге

«Можно сравнить с «Уимблдоном»: Столяров — о миллиарде просмотров, дисциплинах Игр Будущего и выступлении Крида

Хачанов обыграл чеха Меншика в финале турнира ATP в Дохе

Рублёв победил Чжана и пробился во второй круг турнира ATP-500 в Дубае

Хачанов стал победителем турнира ATP 250 в Дохе

На «Юмор FM» продолжается игра «Это МНЕ?!»

ENERGY дарит тур в Мексику на выступление Джареда Лето

Шапки женские вязаные на Wildberries, зима 2024 — новый цвет от 392 руб. (модель 466)

Шапки женские зимние на Wildberries — скидки от 398 руб. (на новые оттенки)

Еще не показаны несколько интервью в Москве: Такера Карлсона пытаются запугать и арестовать

От Арбата до дальних уголков России: Как Московский адвокат Петр Бражников меняет лицо юридической помощи

Очистные сооружения в Чувашии будут строить по новому графику

С 1 марта 2025 года в России вступит в силу закон о самозапрете на кредиты

«Каким бы ни было психическое расстройство, оно не делает родителя плохим»

Праздник сегодня, 28 февраля: традиции, запреты и обряды

В Москве неизвестные похитили 19 общественных велопарковок

Сотрудники на удаленке сейчас есть только в каждой третьей компании Магадана

Путин в России и мире

Персональные новости Russian.city
Анна Нетребко

Нетребко привела 15-летнего сына к полуголой красотке — трясет грудью и попой

News Every Day

Beautiful Outdoor Garden Furniture, Garden Library Interior, Hidden Book Nook Garden Design

Friends of Today24

Музыкальные новости

Персональные новости