Archetype’s AI Model Newton: Deciphering Sensor Data for Real-World Solutions
In today’s fast-paced and intricate physical world, understanding and resolving problems can be a daunting task. However, Archetype, a startup backed by venture capital firm Venrock, is leveraging AI to interpret sensor data and provide valuable insights. As Brandon Barbello, Archetype’s COO and cofounder, explains:
“The physical world is where we have most of our problems, because it is so complex and fast moving that things are beyond our perception to fully understand,” says Brandon Barbello, a cofounder who is also Archetype’s COO. “We put sensors in all kinds of things to help us, but sensor data is too difficult to interpret. There’s a potential to use AI to understand that sensor data—then we can finally understand these problems and solve them.”
Demonstrating Newton’s Potential
During a visit to Archetype’s founding team, they showcased the vast potential of their AI model, Newton, through captivating demonstrations. By placing a motion sensor inside a box and prompting Newton to imagine it as an Amazon package with fragile contents, the model could detect potential damage when the box was dropped. This technology could be invaluable for monitoring sensitive shipments, such as vaccines, ensuring their effectiveness upon arrival.
Conversing with Houses and Factories
One of Newton’s key applications is its ability to “talk to a house or chat with a factory,” as Barbello puts it. Instead of relying on complex dashboards or custom-built software to interpret sensor data from homes or industrial facilities, Newton can provide clear, plain-language descriptions of the situation, similar to ChatGPT. This real-time mirroring of an entire factory can revolutionize how we monitor and optimize operations.
Industry Applications and Partnerships
Amazon, known for its digitally sophisticated logistics operations, is one of Archetype’s backers through its Industrial Innovation Fund. Franziska Bossart, head of the fund, believes that this technology has the potential to optimize the flow of goods and improve delivery speed for customers. Archetype is also exploring applications in healthcare, working with Stefano Bini, a professor at UC San Francisco’s Department of Orthopaedic Surgery, to develop a single metric for assessing recovery progress after knee replacement surgery.
Volkswagen is another early client of Archetype, running tests of the model in scenarios beyond autonomous driving. One experiment involves using a car’s sensors to analyze movement and recognize when its owner is returning from the store, automatically opening the back gate and placing items in specially heated or cooled locations. Brian Lathrop, senior principal scientist at Volkswagen’s Silicon Valley innovation center, believes that this is just the beginning of what becomes possible when AI can digest sensor data into human-centric insights.
Addressing Privacy Concerns
While a trillion-sensor monitoring system providing instant answers about any location might raise privacy concerns, Archetype’s founders assure that they have considered this aspect. They emphasize that radar and other sensor data is more benign compared to cameras, and their customers are focused on solving specific problems without affecting privacy. Lathrop from Volkswagen agrees, stating that their focus is on detecting behavior, not identity. However, it’s worth noting that even seemingly innocuous data, such as the way people walk, can be as distinctive as a fingerprint.
As Archetype continues to develop and refine its AI model Newton, the potential for revolutionizing how we understand and solve problems in the physical world is immense. By harnessing the power of sensor data and AI, we can unlock new possibilities and create innovative solutions across various industries.
6 Comments
Imagine your toaster giving you the silent treatment, hilarious!
Imagine your house passive-aggressively reminding you to do the dishes; the future is here, folks.
So, now buildings and vehicles get to ignore us too, great.
Finally, my fridge can verbally judge my late-night snack choices, fantastic.
V1nce: And here I was thinking my car’s silent judgment was just a feeling, soon it’ll lecture me on eco-driving.
Next up, getting ghosted by your smart toaster for not cleaning the crumbs, pure comedy.