The Future of Intelligent Robots: Insights from Professor Jitendra Malik
The ongoing development of intelligent robots has sparked considerable interest within the academic and technological communities. The Faculty of Engineering of the University of Hong Kong (HKU) hosted a distinguished lecture by Professor Jitendra Malik from the University of California, Berkeley.
His talk, titled "When Will We Have Intelligent Robots?", addressed the critical challenges and future possibilities for robotics, offering valuable insights into the current state of the field.
Key Challenges in Robotics
Professor Malik identified three primary areas—locomotion, navigation, and manipulation—as essential for the advancement of intelligent robots. He emphasised that solving these challenges with sufficient reliability is vital for creating robots that can operate effectively in varied environments. Among these, he regards dexterous manipulation as the most significant hurdle. This complex task involves using multiple fingers to perform actions that humans often take for granted.
He noted that while many animals can use their limbs interchangeably, humans possess a unique ability to manipulate objects with precision using their hands. This distinct capability poses a formidable challenge in robotics, where replicating human dexterity remains a key focus of research.


Overcoming Data Limitations
A significant barrier to progress in robotics, as highlighted by Professor Malik, is the lack of "big data" comparable to that found in language and vision. He explained that learning approaches have driven recent advancements, yet these efforts are stymied by insufficient data. To tackle this issue, he discussed the importance of innovative data collection and integration methods, which can facilitate the training of robots to learn and adapt in real-world scenarios.
Professor Malik's research showcases recent results in locomotion, including humanoid walking demonstrations in challenging environments. Additionally, he presented the "Go to Any Thing" task, in which robots can autonomously locate objects, such as televisions, in unfamiliar settings, such as newly rented Airbnb properties.
Real-World Applications
The potential applications of these advancements are vast, particularly in sectors such as healthcare and elder care. Professor Malik expressed a personal motivation for this work, reflecting on his father's need for constant care in his later years. He believes that robots capable of assisting in daily tasks could significantly improve the quality of life for many individuals, addressing a pressing social need.
Interdisciplinary Collaboration
Professor Malik also stressed the importance of interdisciplinary collaboration in fostering innovation within robotics. He pointed out that insights from fields such as neuroscience and psychology can significantly enhance our understanding of human capabilities, which in turn can inform the design and functionality of robots. His research has benefited from discussions with child psychologists, who have provided valuable perspectives on child development that can be applied to robotic learning and interaction.

The Role of Universities in Knowledge Exchange
In addressing the role of universities, Professor Malik underscored their unique capacity to explore and experiment with new ideas. He noted that academia allows for the pursuit of a wide range of approaches, empowering researchers to take risks that may not be feasible in industry settings. Conversely, the industry can apply these innovations at scale, creating a symbiotic relationship between academic research and practical application.
The Future of Robotics
Looking ahead, Professor Malik expressed optimism about the future of robotics, particularly in the development of home robots. He envisions these machines as essential companions that can assist individuals with daily chores and enhance overall well-being. This vision aligns with the broader goal of utilising technology for social good—an ethos that resonates deeply with his work.

Professor Jitendra Malik
About Professor Jitendra Malik
Professor Malik serves as the Arthur J. Chick Professor of Electrical Engineering and Computer Sciences at UC Berkeley and is Vice President of Robotics Research at FAIR, Meta Inc. His research encompasses a wide range of topics within computer vision, machine learning, and robotics, leading to significant breakthroughs and numerous accolades. He has mentored over 80 PhD students, many of whom have become leaders in their fields.
Professor Malik has received several prestigious awards, including the ACM/AAAI Allen Newell Award and the IEEE Computer Society’s Computer Pioneer Award, recognising his contributions to establishing computer vision as a vital discipline. He is a member of the US National Academy of Sciences and the National Academy of Engineering.
William Mong Distinguished Lecture series
The William M.W. Mong Research Fund provides funding to research and academic activities in the Faculty of Engineering. The Fund is established with the kind and generous donation of $10 million in 1991 from Dr. William M.W. Mong, Chairman of Shun Hing Group. Dr Mong's generosity of spirit and willingness to donate is ubiquitous in the University and the Hong Kong community. Shun Hing Education and Charity Fund Limited has been most active in community and charity work for many years and has given unreserved support to local education.
The William Mong Distinguished Lecture series, supported by the Fund, aims to bring distinguished scholars and experts from diverse fields to HKU. This series is intended to enhance academic discourse and promote knowledge exchange by featuring lectures on cutting-edge research and contemporary issues. It provides an opportunity for students, faculty, and the wider community to engage with thought leaders, fostering a dynamic learning environment and encouraging interdisciplinary dialogue.
For more details about the lectures, please visit: https://engg.hku.hk/William-Mong-Research-Fund