March 2010 April 2010 May 2010 June 2010 July 2010
August 2010
September 2010 October 2010
November 2010
December 2010
January 2011
February 2011 March 2011 April 2011 May 2011 June 2011 July 2011 August 2011 September 2011 October 2011 November 2011 December 2011 January 2012 February 2012 March 2012 April 2012 May 2012 June 2012 July 2012 August 2012 September 2012 October 2012 November 2012 December 2012 January 2013 February 2013 March 2013 April 2013 May 2013 June 2013 July 2013 August 2013 September 2013 October 2013 November 2013 December 2013 January 2014 February 2014 March 2014 April 2014 May 2014 June 2014 July 2014 August 2014 September 2014 October 2014 November 2014 December 2014 January 2015 February 2015 March 2015 April 2015 May 2015 June 2015 July 2015 August 2015 September 2015 October 2015 November 2015 December 2015 January 2016 February 2016 March 2016 April 2016 May 2016 June 2016 July 2016 August 2016 September 2016 October 2016 November 2016 December 2016 January 2017 February 2017 March 2017 April 2017 May 2017 June 2017 July 2017 August 2017 September 2017 October 2017 November 2017 December 2017 January 2018 February 2018 March 2018 April 2018 May 2018 June 2018 July 2018 August 2018 September 2018 October 2018 November 2018 December 2018 January 2019 February 2019 March 2019 April 2019 May 2019 June 2019 July 2019 August 2019 September 2019 October 2019 November 2019 December 2019 January 2020 February 2020 March 2020 April 2020 May 2020 June 2020 July 2020 August 2020 September 2020 October 2020 November 2020 December 2020 January 2021 February 2021 March 2021 April 2021 May 2021 June 2021 July 2021 August 2021 September 2021 October 2021 November 2021 December 2021 January 2022 February 2022 March 2022 April 2022 May 2022 June 2022 July 2022 August 2022 September 2022 October 2022 November 2022 December 2022 January 2023 February 2023 March 2023 April 2023 May 2023 June 2023 July 2023 August 2023 September 2023 October 2023 November 2023 December 2023 January 2024 February 2024 March 2024 April 2024
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21
22
23
24
25
26
27
28
29
30
News Every Day |

Meet Sharon Zhou, the AI founder doing just fine without Nvidia's chips

Sharon Zhou, Lamini AI CEO and cofounder
Sharon Zhou, Lamini AI CEO and cofounder
  • Everyone in AI has been seemingly falling over themselves for Nvidia's chips.
  • Everyone that is, except Sharon Zhou.
  • The Lamini AI CEO has been using rival AMD's GPUs to take her startup forward.

Tech CEOs with big plans for artificial intelligence spent a bunch of time scrambling around in search of Nvidia chips last year.

The Santa Clara giant's chips, known as GPUs, became the hottest property of the generative AI boom. Figures as powerful as Mark Zuckerberg and Sam Altman raced to secure supplies of the vital computing resources needed to power apps like ChatGPT.

However, there's one AI boss who hasn't put herself at the mercy of Nvidia's billionaire leader Jensen Huang, and his $2.2 trillion GPU empire. Meet Sharon Zhou.

The 30-year-old has had quite the career.

She's the first person to major in both classics and computer science at Harvard. She received a Ph.D. in generative AI at Stanford under machine learning pioneer Andrew Ng, became an adjunct professor at the university, and has made time for online teaching and angel investing. If that wasn't enough, she was also asked to be on the early founding team of Anthropic, the OpenAI rival that just raised an extra $2.75 billion from Amazon.

Her ambitions have taken her in a slightly different direction, however, as she's now forging her own path forward by taking charge of an AI startup of her own.

Who needs Nvidia?

In April last year, Zhou and her cofounder Greg Diamos, based in Palo Alto, brought their new startup, Lamini AI, out of stealth. Its main ambition was to offer a platform that makes it easy for enterprises to train and create customized large language models with "just a few lines of code."

That could mean taking a foundation model like GPT from OpenAI and making it easy for an enterprise to fine-tune that model with its own data. "What we're doing is making it essentially possible for every enterprise to have OpenAI's infrastructure but in-house," Zhou said.

An equally interesting revelation came months later, however.

In September, Zhou revealed that Lamini's platform had been building customized LLMs with customers over the past year by exclusively using GPUs from Nvidia's main rival, AMD, the chip giant run by Huang's cousin, Lisa Su.

It was a big deal given that almost everyone seemed to be exclusively obsessed with H100 — GPUs that Nvidia has struggled to meet the demand of amid supply constraints. Lamini's reveal even came with a video of Zhou teasing Nvidia about the shortage.

As Zhou acknowledges, though, it wasn't an easy decision to look away from the thing everyone in generative AI has been desperate for. "The decision-making process was a long one," she said. "It was not a trivial, small one."

A few things helped the decision. For one, her cofounder Diamos played a key role in helping make the realization that GPUs other than those from Nvidia work perfectly well.

As a former Nvidia software architect, Diamos understood that while GPU hardware was vital for getting top performance out of AI models — he was, after all, the coauthor of a paper on "scaling laws" that showed the importance of computing power — software was important too.

Diamos was witness to that having worked on CUDA, the software first developed by Nvidia in the 2000s. It makes using AI models with GPUs like the H100 and Nvidia's new Blackwell chip, as simple as a plug-and-play system.

Jensen Huang at Nvidia's 2024 developer conference
Nvidia CEO Jensen Huang.

So it became clear that if another company could build a similar software ecosystem around its GPUs, there'd be no reason they couldn't compete with Nvidia. Fortunately for them, after consulting with Diamos, according to Zhou, AMD was on its way to building a rival system that they would eventually test.

"Greg and I were just jamming on things, so this has been years in the making, and then once the prototypes worked we were just like let's just double down on this," Zhou said.

More broadly, Zhou recognizes that businesses are so "excited to use LLMs," but many may not want to — or simply can't afford to — wait around for Nvidia to shore up enough supply of its GPUs to meet the demand.

It's another reason AMD has proven so valuable to her ambitions. Thanks to its GPUs being more available, Zhou was confident that Lamini could offer "infrastructure that makes meeting that skyrocketing demand" for LLMs possible.

"This is because Lamini fully utilizes LLM compute at 10x performance and makes it possible to scale quickly without supply constraints, by offering vendor-agnostic compute options, i.e. it's indiscernible to customers to run Lamini on Nvidia and AMD GPUs," she explained.

No wonder the company is ready to double down on AMD. In January, Zhou shared an image to X of the MI300X — AMD's new chip first unveiled in December by CEO Su as the "highest performing accelerator in the world" — live in production at Lamini.

Nvidia's Huang might be leading one of the most powerful companies in Silicon Valley now, but the competition is coming for him. Or as Zhou said of AMD: "They have a real horse in this race."

Read the original article on Business Insider
Москва

Где "гуляют" миллиарды неучтенных наличных? Толстой указал на характерные детали убийства мотоциклиста мигрантом в Москве

Cyprus Closed Chess Championship names winners

Четвертый том в серии ко Дню космонавтики

Trump trial: Jury selection to resume in New York City for 3rd day in former president's trial

Life On The Green: Jack Nicklaus, golf legends impart wealth of wisdom in Ann Liguori’s new book

Ria.city






Read also

Dogs That Would ‘Demolish’ Toys ‘Instantly’ Adore This Durable $9 Crinkle Toy

My Pine-Sol hack is so smart – it keeps a commonly ignored bathroom tool clean and the room smells extra fresh

EASY Sugar Cookies Recipe (No Chill, No Spread) + Tips - Cooking With Karli

News, articles, comments, with a minute-by-minute update, now on Today24.pro

News Every Day

'Sticking his thumb in the judge's face': Michael Cohen says $1k gag order fines are joke

Today24.pro — latest news 24/7. You can add your news instantly now — here


News Every Day

Cyprus Closed Chess Championship names winners



Sports today


Новости тенниса
Елена Рыбакина

Лучшая теннисистка мира сделала заявление перед матчем с Еленой Рыбакиной



Спорт в России и мире
Москва

ЦСКА потерпел сенсационное домашнее поражение в матче с «Ахматом»



All sports news today





Sports in Russia today

Москва

ЦСКА потерпел сенсационное домашнее поражение в матче с «Ахматом»


Новости России

Game News

'The concerns about claustrophobia were a major aspect' of desiging World of Warcraft: The War Within's underground zones, says director


Russian.city


Москва

Собянин: В Петровском парке отреставрируют монументы Жуковскому и Циолковскому


Губернаторы России
Сергей Собянин

Собянин заявил, что за пожарной безопасностью смоленских лесов будут следить с воздуха


Подключение водонагревателя в Московской области

С чего начать занятия спортом детям с лишним весом: мнение тренера

Опубликован план мира, способный улучшить отношения между Россией, Нато, Украиной

Пепельницу любителя скачек XIX века обнаружили в Хамовниках


Турбо из «Слова пацана» раскрыл правду о личной жизни на съёмках Comedy Club

Variety: актер Леонардо Ди Каприо сыграет Фрэнка Синатру в байопике Скорсезе

Леонардо ДиКаприо может сыграть Фрэнка Синатру в новом байопике Скорсезе

"Знай наших!"


Александрова проиграла Жабер в первом круге турнира WTA в Штутгарте

Названа победительница матча Елена Рыбакина — Ига Швентек

WTA отреагировала на суперкамбэк Елены Рыбакиной

Что чаще всего едят на завтрак дети Елены и Новака Джокович?



Kub Mash: в Москве водитель шесть раз протаранил машину семьи из Краснодара

Автор хита "Поезда" Женя Трофимов рассказал, почему Барнаул лучше Москвы

В Подмосковном центре охраны материнства и детства принимает новый врач

Суд арестовал троих фигурантов по делу о поставке несвежих продуктов в ВС РФ


Концерт в честь Дня труда прошел в Красногорске

В Московской области сотрудники Росгвардии задержали подозреваемого в краже дорогостоящих технических устройств

В Екатеринбурге Росгвардия обеспечила правопорядок на футбольном матче Чемпионата России

Монако остался в прошлом: Боня начала обустраивать жизнь в Москве


Омбудсмен Московской области помог решить спор предпринимателя и ведомства

Al Jazeera: На территории больницы Насер нашли массовое захоронение палестинцев

В ответе перед земляками

"Память о счастье" в музее Тропинина в Москве.



Путин в России и мире






Персональные новости Russian.city
Comedy Club

Турбо из «Слова пацана» раскрыл правду о личной жизни на съёмках Comedy Club



News Every Day

'Sticking his thumb in the judge's face': Michael Cohen says $1k gag order fines are joke




Friends of Today24

Музыкальные новости

Персональные новости