Humans may be one of the biggest roadblocks keeping fully autonomous vehicles off city streets.<\/p>\n<\/p>\n
If a robot is going to navigate a vehicle safely through downtown Boston, it must be able to predict what nearby drivers, cyclists, and pedestrians are going to do next.<\/p>\n<\/p>\n
Behavior prediction is a tough problem, however, and current artificial intelligence solutions are either too simplistic (they may assume pedestrians always walk in a straight line), too conservative (to avoid pedestrians, the robot just leaves the car in park), or can only forecast the next moves of one agent (roads typically carry many users at once.)\u00a0\u00a0<\/p>\n<\/p>\n
MIT researchers have devised a deceptively simple solution to this complicated challenge. They break a multiagent behavior prediction problem into smaller pieces and tackle each one individually, so a computer can solve this complex task in real-time.<\/p>\n<\/p>\n
Their behavior-prediction framework first guesses the relationships between two road users \u2014 which car, cyclist, or pedestrian has the right of way, and which agent will yield \u2014 and uses those relationships to predict future trajectories for multiple agents.<\/p>\n<\/p>\n
These estimated trajectories were more accurate than those from other machine-learning models, compared to real traffic flow in an enormous dataset compiled by autonomous driving company Waymo. The MIT technique even outperformed Waymo\u2019s recently published model. And because the researchers broke the problem into simpler pieces, their technique used less memory.<\/p>\n<\/p>\n
\u201cThis is a very intuitive idea, but no one has fully explored it before, and it works quite well. The simplicity is definitely a plus. We are comparing our model with other state-of-the-art models in the field, including the one from Waymo, the leading company in this area, and our model achieves top performance on this challenging benchmark. This has a lot of potential for the future,\u201d says co-lead author Xin \u201cCyrus\u201d Huang, a graduate student in the Department of Aeronautics and Astronautics and a research assistant in the lab of Brian Williams, professor of aeronautics and astronautics and a member of the Computer Science and Artificial Intelligence Laboratory (CSAIL).<\/p>\n<\/p>\n
Joining Huang and Williams on the paper<\/a> are three researchers from Tsinghua University in China: co-lead author Qiao Sun, a research assistant; Junru Gu, a graduate student; and senior author Hang Zhao PhD \u201919, an assistant professor. The research will be presented at the Conference on Computer Vision and Pattern Recognition.<\/p>\n<\/p>\n Multiple<\/strong> small<\/strong> models<\/strong><\/p>\n<\/p>\n The researchers\u2019 machine-learning method, called M2I, takes two inputs: past trajectories of the cars, cyclists, and pedestrians interacting in a traffic setting such as a four-way intersection, and a map with street locations, lane configurations, etc.<\/p>\n<\/p>\n Using this information, a relation predictor infers which of two agents has the right of way first, classifying one as a passer and one as a yielder. Then a prediction model, known as a marginal predictor, guesses the trajectory for the passing agent, since this agent behaves independently.<\/p>\n<\/p>\n A second prediction model, known as a conditional predictor, then guesses what the yielding agent will do based on the actions of the passing agent. The system predicts a number of different trajectories for the yielder and passer, computes the probability of each one individually, and then selects the six joint results with the highest likelihood of occurring.<\/p>\n<\/p>\n M2I outputs a prediction of how these agents will move through traffic for the next eight seconds. In one example, their method caused a vehicle to slow down so a pedestrian could cross the street, then speed up when they cleared the intersection. In another example, the vehicle waited until several cars had passed before turning from a side street onto a busy, main road.<\/p>\n<\/p>\n While this initial research focuses on interactions between two agents, M2I could infer relationships among many agents and then guess their trajectories by linking multiple marginal and conditional predictors.<\/p>\n Real-world d<\/strong>riving tests<\/strong><\/p>\n<\/p>\n The researchers trained the models using the Waymo Open Motion Dataset, which contains millions of real traffic scenes involving vehicles, pedestrians, and cyclists recorded by lidar (light detection and ranging) sensors and cameras mounted on the company\u2019s autonomous vehicles. They focused specifically on cases with multiple agents.<\/p>\n<\/p>\n To determine accuracy, they compared each method\u2019s six prediction samples, weighted by their confidence levels, to the actual trajectories followed by the cars, cyclists, and pedestrians in a scene. Their method was the most accurate. It also outperformed the baseline models on a metric known as overlap rate; if two trajectories overlap, that indicates a collision. M2I had the lowest overlap rate.<\/p>\n<\/p>\n \u201cRather than just building a more complex model to solve this problem, we took an approach that is more like how a human thinks when they reason about interactions with others. A human does not reason about all hundreds of combinations of future behaviors. We make decisions quite fast,\u201d Huang says.<\/p>\n<\/p>\n Another advantage of M2I is that, because it breaks the problem down into smaller pieces, it is easier for a user to understand the model\u2019s decision making. In the long run, that could help users put more trust in autonomous vehicles, says Huang.<\/p>\n<\/p>\n But the framework can\u2019t account for cases where two agents are mutually influencing each other, like when two vehicles each nudge forward at a four-way stop because the drivers aren\u2019t sure who should be yielding.<\/p>\n<\/p>\n They plan to address this limitation in future work. They also want to use their method to simulate realistic interactions between road users, which could be used to verify planning algorithms for self-driving cars or create huge amounts of synthetic driving data to improve model performance.<\/p>\n<\/p>\n \u201cPredicting future trajectories of multiple, interacting agents is under-explored and extremely challenging for enabling full autonomy in complex scenes. M2I provides a highly promising prediction method with the relation predictor to discriminate agents predicted marginally or conditionally which significantly simplifies the problem,\u201d wrote Masayoshi Tomizuka, the Cheryl and John Neerhout, Jr. Distinguished Professor of Mechanical Engineering at University of California at Berkeley and Wei Zhan, an assistant professional researcher, in an email. \u201cThe prediction model can capture the inherent relation and interactions of the agents to achieve the state-of-the-art performance.\u201d The two colleagues were not involved in the research.<\/p>\n<\/p>\n This research is supported, in part, by the Qualcomm Innovation Fellowship. Toyota Research Institute also provided funds to support this work.<\/p>\n<\/div>\n Go to Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"![\"prediction\"](\"https:\/\/news.mit.edu\/sites\/default\/files\/images\/inline\/driving-prediction-1.gif\")
![\"prediction\"](\"https:\/\/news.mit.edu\/sites\/default\/files\/images\/inline\/driving-prediction-2.gif\")
<\/p>\n