{"id":20,"date":"2017-05-19T13:35:43","date_gmt":"2017-05-19T11:35:43","guid":{"rendered":"https:\/\/www-mobilemii.cea.fr\/?page_id=20"},"modified":"2021-09-08T15:17:12","modified_gmt":"2021-09-08T13:17:12","slug":"research","status":"publish","type":"page","link":"https:\/\/www-mobilemii.cea.fr\/?page_id=20","title":{"rendered":"Research"},"content":{"rendered":"<ul>\n<li style=\"text-align: left;\">\n<h2 style=\"text-align: left;\">Research at CEA LIST : Examples of Human Behaviour research topics<\/h2>\n<h3 style=\"text-align: center;\">Daily activity understanding<\/h3>\n<h3 style=\"text-align: center;\"><div class='content-column one_half'><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-153\" src=\"https:\/\/www-mobilemii.cea.fr\/wp-content\/uploads\/2017\/05\/mmii02-300x215.png\" alt=\"\" width=\"300\" height=\"215\" srcset=\"https:\/\/www-mobilemii.cea.fr\/wp-content\/uploads\/2017\/05\/mmii02-300x215.png 300w, https:\/\/www-mobilemii.cea.fr\/wp-content\/uploads\/2017\/05\/mmii02.png 301w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/div><div class='content-column one_half last_column'><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-151\" src=\"https:\/\/www-mobilemii.cea.fr\/wp-content\/uploads\/2017\/05\/mmii01-300x182.png\" alt=\"\" width=\"363\" height=\"220\" srcset=\"https:\/\/www-mobilemii.cea.fr\/wp-content\/uploads\/2017\/05\/mmii01-300x182.png 300w, https:\/\/www-mobilemii.cea.fr\/wp-content\/uploads\/2017\/05\/mmii01.png 631w\" sizes=\"(max-width: 363px) 100vw, 363px\" \/><\/div><div class='clear_column'><\/div><\/h3>\n<h3 style=\"text-align: center;\"><div class='content-column one_half'>Affective Computing<\/div><div class='content-column one_half last_column'>User \/ Environment Interactions<\/div><div class='clear_column'><\/div><\/h3>\n<h3 style=\"text-align: center;\"><div class='content-column one_half'><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-155\" src=\"https:\/\/www-mobilemii.cea.fr\/wp-content\/uploads\/2017\/05\/mmii04-272x300.png\" alt=\"\" width=\"215\" height=\"237\" srcset=\"https:\/\/www-mobilemii.cea.fr\/wp-content\/uploads\/2017\/05\/mmii04-272x300.png 272w, https:\/\/www-mobilemii.cea.fr\/wp-content\/uploads\/2017\/05\/mmii04.png 396w\" sizes=\"(max-width: 215px) 100vw, 215px\" \/><\/div><div class='content-column one_half last_column'><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-154\" src=\"https:\/\/www-mobilemii.cea.fr\/wp-content\/uploads\/2017\/05\/mmii03-300x183.png\" alt=\"\" width=\"326\" height=\"199\" srcset=\"https:\/\/www-mobilemii.cea.fr\/wp-content\/uploads\/2017\/05\/mmii03-300x183.png 300w, https:\/\/www-mobilemii.cea.fr\/wp-content\/uploads\/2017\/05\/mmii03.png 317w\" sizes=\"(max-width: 326px) 100vw, 326px\" \/><\/div><div class='clear_column'><\/div><\/h3>\n<\/li>\n<li style=\"text-align: left;\">\n<h2>Realistic datasets<\/h2>\n<\/li>\n<\/ul>\n<p><span style=\"padding-left: 35px;\"><strong>DAHLIA (DAily Human Life Activity)<\/strong><\/span><\/p>\n<p><span style=\"padding-left: 35px;\">DAHLIA dataset is devoted to human activity recognition, which is a major issue for adapting\u00a0smart-home services such as user assistance. <\/span><\/p>\n<p><span style=\"padding-left: 35px;\">DAHLIA has been realized in Mobile Mii Platform by CEA LIST,\u00a0and has been partly supported by ITEA 3 Emospaces Project (https:\/\/itea3.org\/project\/emospaces.html) <\/span><\/p>\n<p><span style=\"padding-left: 35px;\">DALHIA has been published at the 12th IEEE Conference on Automatic Face &amp; Gesture Recognition, Washington DC, USA, May 31th &#8211; 3rd June, 2017. <a href=\"https:\/\/ieeexplore.ieee.org\/document\/7961782\" target=\"_blank\" rel=\"noopener noreferrer\">See Paper here<\/a><br \/>\n<\/span><\/p>\n<p><span style=\"padding-left: 35px;\">Videos were recorded in realistic conditions, with 3 Kinect v2 sensors located as they would be in a real context. The long-range activities were performed in an unconstrained way (participants received only few instructions), and in a continuous (untrimmed) sequence, resulting in long videos (40 min in average per subject). Contrary to previously published databases, in which labeled actions are very short and have low-semantic level, this new database focuses on high-level semantic activities such as \u00ab\u00a0Preparing lunch\u00a0\u00bb or \u00ab\u00a0House Working\u00a0\u00bb.<\/span><\/p>\n<p><video id=\"video\" src=\"https:\/\/www-mobilemii.cea.fr\/downloads\/DAHLIA.mp4\" controls=\"controls\" width=\"300\" height=\"400\"><\/video><\/p>\n<p><span style=\"padding-left: 35px;\"><strong>DAHLIA Datafile Package:<\/strong><\/span><\/p>\n<p>The dataset is devided into two sets:<br \/>\n&#8211; set1: 25 examples<br \/>\n&#8211; set2: 26 examples<\/p>\n<p>The tree structure and content of directories is done as below:<br \/>\n<div class='content-column one_third'><span style=\"padding-left: 35px;\">set1\/<\/span><br \/>\n<span style=\"padding-left: 55px;\">S01_A1\/<\/span><br \/>\n<span style=\"padding-left: 75px;\">Label\/<\/span><br \/>\n<span style=\"padding-left: 75px;\">S01_A1_K1\/<\/span><br \/>\n<span style=\"padding-left: 75px;\">S01_A1_K2\/<\/span><br \/>\n<span style=\"padding-left: 75px;\">S01_A1_K3\/<\/span><br \/>\n<span style=\"padding-left: 120px;\">Color\/<\/span><br \/>\n<span style=\"padding-left: 120px;\">Depth\/<\/span><br \/>\n<span style=\"padding-left: 120px;\">Time\/<\/span><br \/>\n<span style=\"padding-left: 120px;\">Body\/<\/span><br \/>\n<span style=\"padding-left: 120px;\">BodyIndex.7z<\/span><br \/><\/div><\/p>\n<div class='content-column two_third last_column'>In a set, examples are ordered by subject and acquisition number.<br \/>\nIn each examples, you will find the directories for each stream of the three cameras and the Label directory which is common to all views.<\/p>\n<ul>\n<li style=\"text-align: left;\">Label : The xml files with activity label for each frames.<br \/>\nActivities are : Cooking (id: 1) &#8211; Laying table (2) &#8211; Eating (3) &#8211; Clearing Table (4) &#8211; Washing dishes (5) &#8211; Housework (6) &#8211; Working (7) &#8211; Neutral (0)<\/li>\n<li style=\"text-align: left;\">Color : The RGB avi video file<\/li>\n<li style=\"text-align: left;\">Depth : The jpg2000 files corresponding to depth map<\/li>\n<li style=\"text-align: left;\">Time : The timestamp files<\/li>\n<li style=\"text-align: left;\">Body : The csv files with skeleton 3D coordinates.<br \/>\nFileskeleton.csv: expressed in depth map referential. FileskeletonSkSpace.csv: expressend in real world referential.<\/li>\n<li style=\"text-align: left;\">BodyIndex.7z : (when extracted,) The body index binaries files which can be decoded in tif files thanks to the C++ software: <a href=\"https:\/\/github.com\/CEA-LIST\/DAHLIA-BodyIndex\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/github.com\/CEA-LIST\/DAHLIA-BodyIndex<\/a><br \/>\nYou will then obtain a black and white image correponding to the body index returned by the Kinect v2.<\/li>\n<\/ul><\/div><div class='clear_column'><\/div>\n<p><span style=\"padding-left: 35px;\"><strong>Benchmark on DAHLIA:<\/strong><\/span><\/p>\n\n<table id=\"tablepress-2\" class=\"tablepress tablepress-id-2\">\n<thead>\n<tr class=\"row-1 odd\">\n\t<th class=\"column-1\">Benchmark<\/th><th class=\"column-2\">&nbsp;<\/th><th class=\"column-3\">&nbsp;<\/th><th class=\"column-4\">&nbsp;<\/th><th class=\"column-5\">&nbsp;<\/th><th class=\"column-6\">&nbsp;<\/th><th class=\"column-7\">&nbsp;<\/th><th class=\"column-8\">&nbsp;<\/th><th class=\"column-9\">&nbsp;<\/th><th class=\"column-10\">&nbsp;<\/th><th class=\"column-11\">&nbsp;<\/th><th class=\"column-12\">&nbsp;<\/th><th class=\"column-13\">&nbsp;<\/th><th class=\"column-14\">&nbsp;<\/th><th class=\"column-15\">&nbsp;<\/th><th class=\"column-16\">&nbsp;<\/th>\n<\/tr>\n<\/thead>\n<tbody class=\"row-hover\">\n<tr class=\"row-2 even\">\n\t<td class=\"column-1\"><\/td><td colspan=\"15\" class=\"column-2\">Skeleton based<\/td>\n<\/tr>\n<tr class=\"row-3 odd\">\n\t<td class=\"column-1\"><\/td><td colspan=\"3\" class=\"column-2\">View 1<\/td><td colspan=\"3\" class=\"column-5\">View 2<\/td><td colspan=\"3\" class=\"column-8\">View 3<\/td><td colspan=\"3\" class=\"column-11\">Multi-View<\/td><td colspan=\"3\" class=\"column-14\">Cross-View<\/td>\n<\/tr>\n<tr class=\"row-4 even\">\n\t<td class=\"column-1\"><\/td><td class=\"column-2\">FA1<\/td><td class=\"column-3\">F-Score<\/td><td class=\"column-4\">IoU<\/td><td class=\"column-5\">FA1<\/td><td class=\"column-6\">F-Score<\/td><td class=\"column-7\">IoU<\/td><td class=\"column-8\">FA1<\/td><td class=\"column-9\">F-Score<\/td><td class=\"column-10\">IoU<\/td><td class=\"column-11\">FA1<\/td><td class=\"column-12\">F-Score<\/td><td class=\"column-13\">IoU<\/td><td class=\"column-14\">FA1<\/td><td class=\"column-15\">F-Score<\/td><td class=\"column-16\">IoU<\/td>\n<\/tr>\n<tr class=\"row-5 odd\">\n\t<td class=\"column-1\"><a href=\"https:\/\/ieeexplore.ieee.org\/document\/7961782\">DOHT<\/a><\/td><td class=\"column-2\">0.60<\/td><td class=\"column-3\">0.58<\/td><td class=\"column-4\">0.42<\/td><td class=\"column-5\">0.63<\/td><td class=\"column-6\">0.60<\/td><td class=\"column-7\">0.44<\/td><td class=\"column-8\">0.73<\/td><td class=\"column-9\">0.71<\/td><td class=\"column-10\">0.56<\/td><td class=\"column-11\">0.65<\/td><td class=\"column-12\">0.64<\/td><td class=\"column-13\">0.48<\/td><td class=\"column-14\">0.34<\/td><td class=\"column-15\">0.31<\/td><td class=\"column-16\">0.19<\/td>\n<\/tr>\n<tr class=\"row-6 even\">\n\t<td class=\"column-1\"><a href=\"https:\/\/arxiv.org\/pdf\/1502.01228.pdf\">ELS<\/a><\/td><td class=\"column-2\">0.18<\/td><td class=\"column-3\">0.18<\/td><td class=\"column-4\">0.11<\/td><td class=\"column-5\">0.27<\/td><td class=\"column-6\">0.26<\/td><td class=\"column-7\">0.16<\/td><td class=\"column-8\">0.52<\/td><td class=\"column-9\">0.55<\/td><td class=\"column-10\">0.39<\/td><td class=\"column-11\"><\/td><td class=\"column-12\"><\/td><td class=\"column-13\"><\/td><td class=\"column-14\">0.31<\/td><td class=\"column-15\">0.32<\/td><td class=\"column-16\">0.21<\/td>\n<\/tr>\n<tr class=\"row-7 odd\">\n\t<td class=\"column-1\"><\/td><td colspan=\"15\" class=\"column-2\">Color based<\/td>\n<\/tr>\n<tr class=\"row-8 even\">\n\t<td class=\"column-1\"><\/td><td colspan=\"3\" class=\"column-2\">View 1<\/td><td colspan=\"3\" class=\"column-5\">View 2<\/td><td colspan=\"3\" class=\"column-8\">View 3<\/td><td colspan=\"3\" class=\"column-11\">Multi-View<\/td><td colspan=\"3\" class=\"column-14\">Cross-View<\/td>\n<\/tr>\n<tr class=\"row-9 odd\">\n\t<td class=\"column-1\"><\/td><td class=\"column-2\">FA1<\/td><td class=\"column-3\">F-Score<\/td><td class=\"column-4\">IoU<\/td><td class=\"column-5\">FA1<\/td><td class=\"column-6\">F-Score<\/td><td class=\"column-7\">IoU<\/td><td class=\"column-8\">FA1<\/td><td class=\"column-9\">F-Score<\/td><td class=\"column-10\">IoU<\/td><td class=\"column-11\">FA1<\/td><td class=\"column-12\">F-Score<\/td><td class=\"column-13\">IoU<\/td><td class=\"column-14\">FA1<\/td><td class=\"column-15\">F-Score<\/td><td class=\"column-16\">IoU<\/td>\n<\/tr>\n<tr class=\"row-10 even\">\n\t<td class=\"column-1\"><a href=\"https:\/\/ieeexplore.ieee.org\/document\/7961782\">DOHT<\/a><\/td><td class=\"column-2\">0.80<\/td><td class=\"column-3\">0.77<\/td><td class=\"column-4\">0.64<\/td><td class=\"column-5\">0.81<\/td><td class=\"column-6\">0.79<\/td><td class=\"column-7\">0.66<\/td><td class=\"column-8\">0.80<\/td><td class=\"column-9\">0.77<\/td><td class=\"column-10\">0.65<\/td><td class=\"column-11\">0.85<\/td><td class=\"column-12\">0.82<\/td><td class=\"column-13\">0.71<\/td><td class=\"column-14\"><\/td><td class=\"column-15\"><\/td><td class=\"column-16\"><\/td>\n<\/tr>\n<tr class=\"row-11 odd\">\n\t<td class=\"column-1\"><a href=\"https:\/\/ieeexplore.ieee.org\/abstract\/document\/7466079\">Max Subgraph Search<\/a><\/td><td class=\"column-2\"><\/td><td class=\"column-3\">0.25<\/td><td class=\"column-4\">0.15<\/td><td class=\"column-5\"><\/td><td class=\"column-6\">0.18<\/td><td class=\"column-7\">0.10<\/td><td class=\"column-8\"><\/td><td class=\"column-9\">0.44<\/td><td class=\"column-10\">0.31<\/td><td class=\"column-11\"><\/td><td class=\"column-12\"><\/td><td class=\"column-13\"><\/td><td class=\"column-14\"><\/td><td class=\"column-15\"><\/td><td class=\"column-16\"><\/td>\n<\/tr>\n<tr class=\"row-12 even\">\n\t<td class=\"column-1\"><a href=\"https:\/\/ieeexplore.ieee.org\/abstract\/document\/8639471\">Sub Activity<\/a><\/td><td class=\"column-2\">0.85<\/td><td class=\"column-3\">0.81<\/td><td class=\"column-4\">0.73<\/td><td class=\"column-5\">0.87<\/td><td class=\"column-6\">0.82<\/td><td class=\"column-7\">0.75<\/td><td class=\"column-8\">0.82<\/td><td class=\"column-9\">0.76<\/td><td class=\"column-10\">0.69<\/td><td class=\"column-11\">0.85<\/td><td class=\"column-12\">0.82<\/td><td class=\"column-13\">0.71<\/td><td class=\"column-14\"><\/td><td class=\"column-15\"><\/td><td class=\"column-16\"><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<!-- #tablepress-2 from cache -->\n<p><span style=\"padding-left: 35px;\">If you have published results of activity recognition on the DAHLIA dataset, please send us an eMail (<a href=\"mailto:dahlia.mobilemii@cea.fr\">dahlia.mobilemii@cea.fr<\/a>) with a link to your official publication in order to update the benchmark table.<\/span><\/p>\n<p><span style=\"padding-left: 35px;\"><strong>Dataset Request Formular:<br \/>\n<div class='w3eden'><!-- WPDM Link Template: Default Template -->\n\n<div class=\"link-template-default card mb-2\">\n    <div class=\"card-body\">\n        <div class=\"media\">\n            <div class=\"mr-3 img-48\"><img decoding=\"async\" class=\"wpdm_icon\" alt=\"Ic\u00f4ne\" src=\"https:\/\/www-mobilemii.cea.fr\/wp-content\/plugins\/download-manager\/assets\/file-type-icons\/pdf.svg\" \/><\/div>\n            <div class=\"media-body\">\n                <h3 class=\"package-title\"><a href='https:\/\/www-mobilemii.cea.fr\/?wpdmpro=dahlia-form'>DAHLIA Form<\/a><\/h3>\n                <div class=\"text-muted text-small\"><i class=\"fas fa-copy\"><\/i> 1 fichier\u00b7s <i class=\"fas fa-hdd ml-3\"><\/i> 16.74 KB<\/div>\n            <\/div>\n            <div class=\"ml-3\">\n                <a class='wpdm-download-link download-on-click btn btn-primary ' rel='nofollow' href='#' data-downloadurl=\"https:\/\/www-mobilemii.cea.fr\/?wpdmpro=dahlia-form&wpdmdl=251&refresh=6a07a5da14c4a1778886106\">T\u00e9l\u00e9charger<\/a>\n            <\/div>\n        <\/div>\n    <\/div>\n<\/div>\n\n<\/div><br \/>\n<\/strong><\/span><\/p>\n<p><span style=\"padding-left: 35px;\">Please download the formular, fulfill, sign and send it by eMail to : <a href=\"mailto:dahlia.mobilemii@cea.fr\">dahlia.mobilemii@cea.fr<\/a><\/span><br \/>\n<span style=\"padding-left: 35px;\">Once we received your fulfiled request, download instructions will be sent to you back.<br \/>\n<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Research at CEA LIST : Examples of Human Behaviour research topics Daily activity understanding Realistic datasets DAHLIA (DAily Human Life Activity) DAHLIA dataset is devoted to human activity recognition, which is a major issue for adapting\u00a0smart-home services such as user assistance. DAHLIA has been realized in Mobile Mii Platform by CEA LIST,\u00a0and has been partly supported by ITEA 3 Emospaces\u2026<\/p>\n","protected":false},"author":2,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-20","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/www-mobilemii.cea.fr\/index.php?rest_route=\/wp\/v2\/pages\/20"}],"collection":[{"href":"https:\/\/www-mobilemii.cea.fr\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www-mobilemii.cea.fr\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www-mobilemii.cea.fr\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www-mobilemii.cea.fr\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=20"}],"version-history":[{"count":45,"href":"https:\/\/www-mobilemii.cea.fr\/index.php?rest_route=\/wp\/v2\/pages\/20\/revisions"}],"predecessor-version":[{"id":309,"href":"https:\/\/www-mobilemii.cea.fr\/index.php?rest_route=\/wp\/v2\/pages\/20\/revisions\/309"}],"wp:attachment":[{"href":"https:\/\/www-mobilemii.cea.fr\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=20"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}