World’s smallest AI supercomputer doesn’t even need the internet – how does it work?
A US tech startup has unveiled what it says is the world’s smallest personal AI supercomputer, minute enough to fit in your pocket.
The Tiiny AI Pocket Lab has been officially verified by Guinness World Records as the smallest personal AI supercomputer ever created.
At first glance, it looks more like a portable power bank than a powerful computer.
But despite its size, the gadget can run extremely advanced AI models directly on the device itself, meaning it does not need the internet, remote servers, or expensive specialist hardware to work.
The company says the device could reduce reliance on large data centres while putting powerful artificial intelligence tools directly into the hands of everyday users.
The AI Pocket Lab, which launched on December 10, is also being promoted as a greener and more secure alternative to traditional cloud-based AI systems – which are increasingly criticised for their high energy use, rising costs and potential privacy risks.
‘Cloud AI has brought remarkable progress, but it also created dependency, vulnerability, and sustainability challenges,’ Samar Bhoj, GTM Director of Tiiny AI, said:
‘This is is the first step toward making advanced AI truly accessible, private, and personal, by bringing the power of large models from the cloud to every individual device.’
The device is designed to help with a wide range of everyday AI tasks and could appeal to creators, developers, researchers and students.
Users can ask it to analyse complex information, generate written content, or carry out multi-step tasks – all without needing to be connected to the internet.
One of its biggest selling points is privacy. Instead of sending information to the cloud, the device stores data such as documents, preferences and past activity directly on the device itself. According to the company, this information is protected with security similar to that used by banks.
Tiiny AI says the Pocket Lab is built to handle most real-world AI tasks that people would use day-to-day.
For more demanding tasks, it can run much larger and more powerful AI models capable of complex reasoning and deeper analysis – while keeping everything stored safely offline on the device.
Despite its small size, the gadget still packs serious computing power.
It runs on a 12-core processor and uses about 65 watts of power, allowing it to perform tasks that would normally require much larger systems. Because it does not rely on power-hungry graphics processors used in many AI systems, it also uses far less electricity and produces a smaller carbon footprint.
Two key technologies help make this possible.
One system improves efficiency by only using the parts of the AI model that are needed for a task, rather than running the entire model every time.
Another technology spreads the workload across different parts of the chip so the device can run AI faster while using less power.
Together, these innovations allow the Pocket Lab to deliver performance similar to much larger AI systems – despite its compact size.
Tiiny AI is also building an open-source ecosystem around the device.
Users can easily install popular open-source AI models and tools with a single click, allowing them to customise the device for their own needs. They can also set up AI assistants and automated tools that help perform different tasks.
The company says the device will receive regular updates, including improvements delivered wirelessly.