Company News

Driver Pose Estimation Using Recurrent Lightweight Network and Virtual Data Augmented Transfer Learning

|

Yazhou Liu, Pongsak Lasang, Sugiri Pranata, Shengmei Shen, Wenchao Zhang
IEEE Transactions on Intelligent Transportation Systems, 2019.06

Driver poses recognition contains three tasks such as body joint, head angle, and face landmark estimation, which is of paramount interest for the advanced driver assistance systems (ADAS). Recently proposed methods intend to use deeper and more complicated networks to achieve better performance, which leads to heavy models that are not feasible for the resource limited applications such as ADAS. To resolve this issue, we have worked on the following aspects: 1) a lightweight network model, which is referred to as recurrent multi-task thin net (RM-ThinNet), has been proposed which was especially designed for the computationally and memory limited devices; 2) a recurrent structure has been introduced to handle the scale difference and dependency between different tasks, and this recurrence ensures the different tasks are accomplished at different stages and their outputs can augment each other; and 3) a virtual data synthesization pipeline and a couple transfer learning method have been presented, by which network can be learnt effectively by relatively a small number of real data. Comparisons with the state-of-the-art methods reveal the superiority of the proposed method and competitive performance can be achieved with smaller model size and faster speed.

Link: https://ieeexplore.ieee.org/abstract/document/8743560

Published in: IEEE Transactions on Intelligent Transportation Systems ( Early Access )

Share

Related Posts

Acceptance of two papers by ICCV’17 Workshop on MS-Celeb-1M: Recognizing One Million Celebrities in the Real World

Panasonic R&D Center Singapore, collaborating with the National University of Singapore (NUS), co-authored two papers that have been accepted by ICCV (International Conference on Computer Vision*) 2017 Workshop on MS-Celeb-1M: Recognizing One Million Celebrities in the Real World, which will be held in Venice, Italy, on October 28th, 2017.

Read more

Paper accepted for publication in the IEEE Transactions on Systems, Man, and Cybernetics: Systems

Collaborating with Nanjing University of Science and Technology (NUST), Panasonic R&D Center Singapore co-authored a paper titled “Modular Lightweight Network…

Read more

Paper accepted at NIPS2017 and another paper at CoR2017

Panasonic R&D Center Singapore, collaborating with Assistant Professor Feng Jiashi of the National University of Singapore (NUS), co-authored a paper1 titled “Dual-Agent GANs for Photorealistic and Identity Preserving Profile Face Synthesis” that has been accepted at the Conference and Workshop on Neural Information Processing Systems (NIPS) 2017

Read more

Joint collaborations with I2R: achieved the No. 2 position at MEC 2017 plus a paper accepted at ICMI 2017

In collaboration with the Institute for Infocomm Research (I2R), Panasonic R&D Center Singapore achieved the No. 2 position in the audio-visual emotion recognition sub-challenge of the Multimodal Emotion Recognition Challenge (MEC) 2017. The challenge (*1) is aimed at the comparison of multimedia processing and machine learning methods for automatic audio and visual emotion analysis.

Read more