There are huge differences in the layouts and numbers of sensors in different smart home environments. Daily activities performed by residents trigger a variety of sensor event streams. Solving the problem of sensor mapping is an important prerequisite for the transfer of activity features in smart homes. However, it is common practice among most of the existing approaches that only sensor profile information or the ontological relationship between sensor location and furniture attachment are used for sensor mapping. The rough mapping seriously restricts the performance of daily activity recognition. This paper presents a mapping approach based on the optimal search for sensors. To begin with, a source smart home that is similar to the target one is selected. Thereafter, sensors in both source and target smart homes are grouped by sensor profile information. In addition, sensor mapping space is built. Furthermore, a small amount of data collected from the target smart home is used to evaluate each instance in sensor mapping space. In conclusion, Deep Adversarial Transfer Network is employed to perform daily activity recognition among heterogeneous smart homes. Testing is conducted using the public CASAC data set. The results have revealed that the proposed approach achieves a 7–10% improvement in accuracy, 5–11% improvement in precision, and 6–11% improvement in F1 score, compared with the existing methods.
Citation: Yunqian Yu, Zhenliang Hao, Guojie Li, Yaqing Liu, Run Yang, Honghe Liu. Optimal search mapping among sensors in heterogeneous smart homes[J]. Mathematical Biosciences and Engineering, 2023, 20(2): 1960-1980. doi: 10.3934/mbe.2023090
There are huge differences in the layouts and numbers of sensors in different smart home environments. Daily activities performed by residents trigger a variety of sensor event streams. Solving the problem of sensor mapping is an important prerequisite for the transfer of activity features in smart homes. However, it is common practice among most of the existing approaches that only sensor profile information or the ontological relationship between sensor location and furniture attachment are used for sensor mapping. The rough mapping seriously restricts the performance of daily activity recognition. This paper presents a mapping approach based on the optimal search for sensors. To begin with, a source smart home that is similar to the target one is selected. Thereafter, sensors in both source and target smart homes are grouped by sensor profile information. In addition, sensor mapping space is built. Furthermore, a small amount of data collected from the target smart home is used to evaluate each instance in sensor mapping space. In conclusion, Deep Adversarial Transfer Network is employed to perform daily activity recognition among heterogeneous smart homes. Testing is conducted using the public CASAC data set. The results have revealed that the proposed approach achieves a 7–10% improvement in accuracy, 5–11% improvement in precision, and 6–11% improvement in F1 score, compared with the existing methods.
[1] | W. Wang, C. Miao, Activity recognition in new smart home environments, in Proceedings of the 3rd International Workshop on Multimedia for Personal Health and Health Care, Seoul, South Korea, (2018), 29–37. https://doi.org/10.1145/3264996.3265001 |
[2] | D. Roggen, K. Foerster, A. Calatroni, G. Troster, The adARC pattern analysis architecture for adaptive human activity recognition systems, J. Ambient Intell. Hum. Comput. , 4 (2013), 169–186. https://doi.org/10.1007/s12652-011-0064-0 doi: 10.1007/s12652-011-0064-0 |
[3] | T. Van Kasteren, G. Englebienne, B. J. Krose, Recognizing activities in multiple contexts using transfer learning, in AAAI Fall Symposium: Ai in Eldercare: New Solutions to Old Problems, (2008), 142–149. |
[4] | P. Rashidi, D. J. Cook, Activity knowledge transfer in smart environments, Pervasive Mob. Comput., 7 (2011), 331–343. https://doi.org/10.1016/j.pmcj.2011.02.007 doi: 10.1016/j.pmcj.2011.02.007 |
[5] | T. Van Kasteren, G. Englebienne, B. J. Krose, Transferring knowledge of activity recognition across sensor networks, in International Conference on Pervasive Computing, Springer, Berlin, Heidelberg, 6030 (2010), 283–300. https://doi.org/10.1007/978-3-642-12654-3_17 |
[6] | D. Cook, K. D. Feuz, N. C. Krishnan, Transfer learning for activity recognition: A survey, Knowl. Inf. Syst., 36 (2013), 537–556. https://doi.org/10.1007/s10115-013-0665-3 doi: 10.1007/s10115-013-0665-3 |
[7] | D. J. Cook, Learning setting-generalized activity models for smart spaces, IEEE Intell. Syst., 27 (2012), 32–38. https://doi.org/10.1109/MIS.2010.112 doi: 10.1109/MIS.2010.112 |
[8] | S. J. Pan, Y. Yang, A survey on transfer learning, IEEE Trans. Knowl. Data Eng., 22 (2009), 1345–1359. https://doi.org/10.1109/TKDE.2009.191. doi: 10.1109/TKDE.2009.191 |
[9] | Y. Tang, L. Zhang, F. Min, J. He, Multiscale deep feature learning for human activity recognition using wearable sensors, IEEE Trans. Ind. Electron., 70 (2022), 2106–2116. https://doi.org/10.1109/TIE.2022.3161812 doi: 10.1109/TIE.2022.3161812 |
[10] | W. Huang, L. Zhang, H. Wu, F. Min, A. Song, Channel-Equalization-HAR: a light-weight convolutional neural network for wearable sensor based human activity recognition, IEEE Trans. Mobile Comput., 2022 (2022). https://doi.org/10.1109/TMC.2022.3174816 doi: 10.1109/TMC.2022.3174816 |
[11] | X. Cheng, L. Zhang, Y. Tang, Y. Liu, H. Wu, J. He, Real-time human activity recognition using conditionally parametrized convolutions on mobile and wearable devices, IEEE Sens. J., 22 (2022), 5889–5901. https://doi.org/10.1109/JSEN.2022.3149337 doi: 10.1109/JSEN.2022.3149337 |
[12] | S. Sonia, R. D. Baruah, Transfer learning in smart home scenario, in 2020 International Joint Conference on Neural Networks (IJCNN), IEEE, Glasgow, UK, (2020), 1–8. https://doi.org/10.1109/IJCNN48605.2020.9206923 |
[13] | P. Rashidi, D. J. Cook, Transferring learned activities in smart environments, in Intelligent Environments, IOS Press, (2009), 185–192. https://doi.org/10.3233/978-1-60750-034-6-185 |
[14] | J. Ye, SLearn: Shared learning human activity labels across multiple datasets, in 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom), IEEE, Athens, Greece, (2018), 1–10. https://doi.org/10.1109/PERCOM.2018.8444594 |
[15] | J. Ye, S. Dobson, F. Zambonelli, XLearn: Learning activity labels across heterogeneous datasets, ACM Trans. Intell. Syst. Technol., 11 (2020), 1–28. https://doi.org/10.1145/3368272 doi: 10.1145/3368272 |
[16] | J. Ye, Shared learning activity labels across heterogeneous, J. Ambient Intell. Smart Environ., 13 (2021), 77–94. https://doi.org/10.3233/AIS-210590 doi: 10.3233/AIS-210590 |
[17] | M. Alirezaie, J. Renoux, U. Köckemann, A. Kristoffersson, L. Karlsson, E. Blomqvist, et al., An ontology-based context-aware system for smart homes: E-care@home, Sensors, 17 (2017), 1586. https://doi.org/10.3390/s17071586 doi: 10.3390/s17071586 |
[18] | Z. E. Wemlinger, L. B. Holder, Cross-environment activity recognition using a shared semantic vocabulary, Pervasive Mob. Comput., 51 (2018), 150–159. https://doi.org/10.1016/j.pmcj.2018.10.004 doi: 10.1016/j.pmcj.2018.10.004 |
[19] | Y. T. Chiang, C. H. Lu, J. Y. J. Hsu, A feature-based knowledge transfer framework for cross-environment activity recognition toward smart home applications, IEEE Trans. Hum.-Mach. Syst., 47 (2017), 310–322. https://doi.org/10.1109/THMS.2016.2641679 doi: 10.1109/THMS.2016.2641679 |
[20] | Y. T. Chiang, J. Y. J. Hsu, Knowledge transfer in activity recognition using sensor profile, in 2012 9th International Conference on Ubiquitous Intelligence and Computing and 9th International Conference on Autonomic and Trusted Computing, IEEE, Fukuoka, Japan, (2012), 180–187. https://doi.org/10.1109/UIC-ATC.2012.78 |
[21] | V. W. Zheng, D. H. Hu, Q. Yang, Cross-domain activity recognition, in Proceedings of the 11th international conference on Ubiquitous computing, ACM, Orlando, USA, (2009), 61–70. https://doi.org/10.1145/1620545.1620554 |
[22] | K. D. Feuz, D. J. Cook, Transfer learning across feature-rich heterogeneous feature spaces via feature-space remapping (FSR), ACM Trans. Intell. Syst. Technol., 6 (2015), 1–27. https://doi.org/10.1145/2629528 doi: 10.1145/2629528 |
[23] | K. D. Feuz, D. J. Cook, Heterogeneous transfer learning for activity recognition using heuristic search techniques, Int. J. Pervasive Comput. Commun., 10 (2014), 393–418. https://doi.org/10.1108/ijpcc-03-2014-0020 doi: 10.1108/ijpcc-03-2014-0020 |
[24] | G. Azkune, A. Almeida, E. Agirre, Cross-environment activity recognition using word embeddings for sensor and activity representation, Neurocomputing, 418 (2020), 280–290. https://doi.org/10.1016/j.neucom.2020.08.044 doi: 10.1016/j.neucom.2020.08.044 |
[25] | D. H. Hu, V. W. Zheng, Y. Qiang, Cross-domain activity recognition via transfer learning, Pervasive Mob. Comput., 7 (2011), 344–358. https://doi.org/10.1016/j.pmcj.2010.11.005 doi: 10.1016/j.pmcj.2010.11.005 |
[26] | D. H. Hu, Q. Yang, Transfer learning for activity recognition via sensor mapping, in Twenty-second international joint conference on artificial intelligence, AAAI, (2011), 1962–1967. https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-328 |
[27] | B. Myagmar, J. Li, S. Kimura, Heterogeneous daily living activity learning through domain invariant feature subspace, IEEE Trans. Big Data, 7 (2020), 922–929. https://doi.org/10.1109/TBDATA.2020.2977626 doi: 10.1109/TBDATA.2020.2977626 |
[28] | A. R. Sanabria, F. Zambonelli, J. Ye, Unsupervised domain adaptation in activity recognition: a Gan-based approach, IEEE Access, 9 (2021), 19421–19438. https://doi.org/10.1109/ACCESS.2021.3053704 doi: 10.1109/ACCESS.2021.3053704 |
[29] | D. J. Cook, A. S. Crandall, B. L. Thomas, N.C. Krishnan, CASAS: A smart home in a box, Computer, 46 (2012), 62–69. https://doi.org/10.1109/MC.2012.328 doi: 10.1109/MC.2012.328 |