The speed with which the new technologies have hit the market is not compared to speed, with talented scientists find creative ways to use them, train them, even turn them into that without which we cannot live. One such researcher is Mit Mad Collend Alexander HTET Kyaw, a postgraduate student who follows the titles of dual master’s degree in the area of calculation and electrical engineering and computer science.
Kyaw takes technology such as artificial intelligence, increased reality and robotics, and combines them with the gesture, speech and recognition of objects to create human workflows, which have the potential to interact with our building environment, change the way we buy complex structures.
One of his latest innovations is a curator AI, for whom he and his postgraduate students have won the first prize – $ 26,000 in Open and Cash – at MIT AI conference AI Build: Generative Voice AI Solutions, Weekly Hackathon on MIT with final presece that took place last autumn in New York City. In cooperation with Kyaw, Richa Gupta (Architecture) and Bradley Bunch, Nidhish Sagar and Michael Won were all from the Ministry of Electrical Engineering and Informatics MIT (EECS).
The AI curator is designed to streamline online furniture shopping by providing a product to context using AI and AR. The platform uses AR to bring the dimensions of the room with the location of windows, doors and existing furniture. Users can then talk about software to describe what new frenishes they want, and the system uses the AI Vision-Jazyk to search and display different options that correspond to the user’s instructions and the visual characteristics of the room.
“Buyers can choose from the proposed options, visualize products in AR and use a natural language to apply for searching, which will be more intuitive, more efficient and more adapted to the furniture selection process,” says Kyaw. “The problem we are trying to solve is that most people you know when to start when a ferrending room, so we developed curator AI to provide intelligent contextual recommendations based on what your room looks like.” Although the curator AI was developed for furniture shopping, it could be expanded for use in other markets.
It is estimated that another example of Kyaw’s work is a product that he and three other postgraduate students created during the MIT Sloan Tech Conference in March 2024. This competition was aimed at helping small businesses; Kyaw and Team decided to set up their work on Painting Company in Cambridge, which employs 10 people. The estimate uses AR and AI technology to recognize objects to perform accurate room measurements and create a detailed estimate of the cost of renovation and/or small work. It also uses generative AI to display pictures of room or rooms because they could look like painting or renovation, and when completing the project, it generates InvVoice.
The team won the hackathon and $ 5,000 in cash. Kyaw’s teammates were Guillaume Allegre, May Khine and Anna Mathy, all of whom they completed MIT in 2024 with a Master’s degree in Business Analytics.
In April, Kyaw lectures TEDx at his alma mater, Cornell University, in which he denies curator AI, estimates and other projects that use AI, AR and robotics to design and build things.
One of these projects is Unlog, for which Kyaw combined AR with gesture recognition to create a software that takes the input from the touch of the fingers on the surface of the material or even in the air, maps the dimensions of building components. Thus, the storage appeared – a towering art sculpture made of ash protocols, which stands on the Cornell campus – was created.
Play the video
Recognition of a gesture for mixed reality based on feedback and robotic production of the tower
VIDEO: Alexander HTET KYAW
UNGS is the possibility that the structures can be created directly from the entire protocol rather than let the log be traveled to the timber that turns into boards or two four, and then sent to a wholesaler or seller. It is a good representation of Kyaw’s desire to use Mattial building in a more sustainable way. Contribution on this work “Recognition of a gesture for mixed reality based on feedback, which was in Proceedings 5. International Conference on Computions and Robic 2024.
Another Kyaw system has developed the simulation of integration physics, gesture recognition and AR to design active bending built with bamboo poles. Gestures allow users of manipulative digital bamboo modules in AR and physics simulation is integrated to visualize how bamboo bends and where to attach bamboo polyes in a way that creates a stable structure. This work appeared in Proceedings 41. Educational and Research in computer help architectural design in Europe, August 2023, as “active bending in mixed reality based on physics: design and production of reconfigurable modular bamboo system”.
Kyaw built a similar idea using bamboo modules to create deployable structures last year Mitdesignx, MIT MAD program, which selects promising startups and provides coaching and financing them. Since then, Kyaw has established Bendshelters to build prefabricated modular bamboo shelters and community space for refugees and displaced people in Myanmar, his home country.
“Where I grew up, in Myanmar, on the day of many everyday effects of climate change and extreme poverty,” Kyaw says. “There is a huge crisis of refugees in the country and I want to think about how I can contribute back to my community.”
His work with Bendshelter was recognized by MIT Sandbox, PKG Social Innovation Challenge and Amazon Robotics’ Prize for Social Good.
At MIT, Kyaw, Kyaw cooperates with Professor Neil Gershenfeld, director of the Bits and Atoms Center, and PhD student Miana Smith to use speech recognition, 3D generative AI and robotic weapons to create a workflow that can build objects in available, today’s and sustainable way. Kyaw holds a bachelor’s degree in architecture and computer science from Cornell. Last year, SJA from Steve Jobs, which provides financing projects at the intersection of technology and art.
“I enjoy examining different types of technologies for designing and making things,” says Kyaw. “Being part of Mad made me think about how all my work is connected and helped to clarify my intentions. My research vision is to design and develop a system and products that allow natural interactions between people, machines and the world around us.”