Abnormal ship behavior detection is essential for maritime navigation safety. Most existing abnormal ship behavior detection methods only build A ship trajectory position outlier detection model; however, the construction of a ship speed outlier detection model is also significant for maritime navigation safety. In addition, in most existing methods for detecting a ship's abnormal behavior based on abnormal thresholds, one unsuitable threshold leads to the risk of the ship not being minimized as much as possible. In this paper, we proposed an abnormal ship behavior detection method based on distance measurement and an isolation mechanism. First, to address the problem of traditional trajectory compression methods and density clustering methods only using ship position information, the minimum description length principle based on acceleration (AMDL) algorithm and Multi-Dimensional Density Clustering (MDDBSCAN) algorithm is used in this study. These algorithms not only considered the position information of the ship, but also the speed information. Second, regarding the issue of the difficulty in determining the anomaly threshold, one method for determining the anomaly threshold based on the relationship between the velocity weights and noise points of the MDDBSCAN algorithm has been introduced. Finally, due to the randomness issue of the selected segmentation value in iForest, a strategy of selectively constructing isolated trees was proposed, thus further improving the efficiency of abnormal ship behavior detection. The experimental results on the historical automatic identification system data set of Xiamen port prove the practicality and effectiveness of our proposed method. Our experiment results show that the proposed method achieves an improvement of about 10% over the trajectory outlier detection based on the local outlier fraction method, about 14% over the isolation-based online anomalous trajectory method in terms of the accuracy of ship position information anomaly detection, and about 3% over the feature fusion method in terms of the accuracy of ship speed anomaly detection. This method improves algorithm efficiency by about 5% compared to the traditional isolation forest anomaly detection algorithm.
Citation: Lixiang Zhang, Yian Zhu, Jie Ren, Wei Lu, Ye Yao. A method for detecting abnormal behavior of ships based on multi-dimensional density distance and an abnormal isolation mechanism[J]. Mathematical Biosciences and Engineering, 2023, 20(8): 13921-13946. doi: 10.3934/mbe.2023620
Abnormal ship behavior detection is essential for maritime navigation safety. Most existing abnormal ship behavior detection methods only build A ship trajectory position outlier detection model; however, the construction of a ship speed outlier detection model is also significant for maritime navigation safety. In addition, in most existing methods for detecting a ship's abnormal behavior based on abnormal thresholds, one unsuitable threshold leads to the risk of the ship not being minimized as much as possible. In this paper, we proposed an abnormal ship behavior detection method based on distance measurement and an isolation mechanism. First, to address the problem of traditional trajectory compression methods and density clustering methods only using ship position information, the minimum description length principle based on acceleration (AMDL) algorithm and Multi-Dimensional Density Clustering (MDDBSCAN) algorithm is used in this study. These algorithms not only considered the position information of the ship, but also the speed information. Second, regarding the issue of the difficulty in determining the anomaly threshold, one method for determining the anomaly threshold based on the relationship between the velocity weights and noise points of the MDDBSCAN algorithm has been introduced. Finally, due to the randomness issue of the selected segmentation value in iForest, a strategy of selectively constructing isolated trees was proposed, thus further improving the efficiency of abnormal ship behavior detection. The experimental results on the historical automatic identification system data set of Xiamen port prove the practicality and effectiveness of our proposed method. Our experiment results show that the proposed method achieves an improvement of about 10% over the trajectory outlier detection based on the local outlier fraction method, about 14% over the isolation-based online anomalous trajectory method in terms of the accuracy of ship position information anomaly detection, and about 3% over the feature fusion method in terms of the accuracy of ship speed anomaly detection. This method improves algorithm efficiency by about 5% compared to the traditional isolation forest anomaly detection algorithm.
| [1] | C. Claramunt, C. Ray, E. Camossi, A. Jousselme, M. Hadzagic, G. Andrienko, et al., Maritime data integration and analysis: recent progress and research challenges, in 20th International Conference on Extending Database Technology, 2017. |
| [2] |
T. Lv, C. He, J. Zhang, Z. Song, Massive AIS data storage and query based on Hadoop platform, J. Phys. Conf. Ser., 1948 (2021), 012016. https://doi.org/10.1088/1742-6596/1948/1/012016 doi: 10.1088/1742-6596/1948/1/012016
|
| [3] |
L. Zhang, Y. Zhu, W. Lu, J. Wen, A detection and restoration approach for vessel trajectory anomalies based on AIS, J. Northwest. Polytech. Univ., 39 (2021), 119–125. https://doi.org/10.1051/jnwpu/20213910119 doi: 10.1051/jnwpu/20213910119
|
| [4] |
K. Wolsing, L. Roepert, J. Bauer, K. Wehrle, Anomaly detection in maritime AIS tracks: A Re-view of Recent Approaches, J. Mar. Sci. Eng., 10 (2022), 112. https://doi.org/10.3390/jmse10010112 doi: 10.3390/jmse10010112
|
| [5] | C. Tian, Y. Yuan, S. Zhang, C. Lin, W. Zuo, D. Zhang, Image super-resolution with an enhanced group convolutional neural network, 153 (2022), 373–385. https://doi.org/10.1016/j.neunet.2022.06.009 |
| [6] |
C. Tian, Y. Zhang, W. Zuo, C. Lin, D. Zhang, Y. Yuan, A heterogeneous group CNN for image super-resolution, IEEE Trans. Neural Netw. Learn. Syst., 13 (2022). https://doi:10.1109/TNNLS.2022.3210433. doi: 10.1109/TNNLS.2022.3210433
|
| [7] | D. Zhang, L. Nan, Z. Zhou, C. Chen, L. Sun, S. Li, iBAT: Detecting anomalous taxi trajectories from GPS traces, in UbiComp 2011: Ubiquitous Computing, 13th International Conference, (2011), 99–108. https://doi.org/10.1145/2030112.2030127 |
| [8] | J. Zhu, W. Jiang, A. Liu, G. Liu, L. Zhao, Time-dependent popular routes based trajectory outlier detection, in International Conference on Web Information Systems Engineering, 9418 (2015). https://doi.org/10.1007/978-3-319-26190-4_2 |
| [9] |
C. Chen, D. Zhang, P. Castro, N. Li, L. Sun, S. Li, et al., iBOAT: isolation-based online anomalous trajectory detection, IEEE Trans. Intell. Trans. Syst., 14 (2013), 806–818. https://doi.org/10.1109/TITS.2013.2238531 doi: 10.1109/TITS.2013.2238531
|
| [10] |
J. Zhu, W. Jiang, A. Liu, G. Liu, L. Zhao, Effective and efficient trajectory outlier detection based on time-dependent popular route, World Wide Web, 20 (2017), 111–134. https://doi.org/10.1007/s11280-016-0400-6 doi: 10.1007/s11280-016-0400-6
|
| [11] | W. Hao, W. Sun, B. Zheng, A fast trajectory outlier detection approach via driving behavior modeling, in Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, (2017), 837–846. https://doi.org/10.1145/3132847.3132933 |
| [12] | L.Bao, M. Du, A distance-based trajectory outlier detection method on maritime traffic data, in 2018 4th International Conference on Control, Automation and Robotics (ICCAR), 2018. https://doi.org/10.1109/ICCAR.2018.8384697 |
| [13] | E. Martineau, J. Roy, Maritime anomaly detection: domain introduction and review of selected literature, Defense Res. Develop. Canada, 2011. |
| [14] | L. Portnoy, E. Eskin, S. Stolfo, Intrusion detection with unlabeled data using clustering, ACM Workshop Data Mining Appl., 2001. |
| [15] |
S. Zhang, Q. Tang, Abnormal vessel behavior detection based on AIS Data, Artif. Intell. Rob. Res., 04 (2015), 23–31. https://doi.org/10.12677/airr.2015.44004 doi: 10.12677/airr.2015.44004
|
| [16] | R. Lane, D. Nevell, S. Hayward, T. W. Beaney, Maritime anomaly detection and threat assessment, in 2010 13th International Conference on Information Fusion, (2010), 1–8. https://doi.org/10.1109/ICIF.2010.5711998 |
| [17] | R. Laxhammar, Anomaly detection for sea surveillance, in International Conference on Information Fusion, (2008), 1–8. |
| [18] |
Y. Wang, J. Liu, R. Liu, Y. Liu, Z. Yuan, Data-driven methods for detection of abnormal ship behavior: Progress and trends, Ocean Eng., 271 (2023). https://doi.org/10.1016/j.oceaneng.2023.113673 doi: 10.1016/j.oceaneng.2023.113673
|
| [19] | F. Luan, Y. Zhang, K. Cao, Q. Li, Based local density trajectory outlier detection with partition-and-detect framework, in 2017 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD), (2017), 1708–1714. https://doi.org/10.1109/FSKD.2017.8393023 |
| [20] | B. Liang, S. Wu, W. Chen, Z. Zhu, Trajectory outlier detection based on partition-and-detection framework, in 2017 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD), 2017. https://doi.org/10.1109/FSKD.2017.8393071 |
| [21] |
A. Belhadi, Y. Djenouri, D. Djenouri, T. Michalak, J. C. Lin, Deep learning versus traditional solutions for group trajectory outliers, IEEE Trans. Cybernetics, 6 (2020), 1–12. https://doi.org/10.1109/TCYB.2020.3029338 doi: 10.1109/TCYB.2020.3029338
|
| [22] |
M. Szarmach, I. Czarnowski, Multi-Label classification for AIS data anomaly detection using wavelet transform, IEEE Access, 10 (2022), 109119–109131. https://doi.org/10.1109/ACCESS.2022.3214217 doi: 10.1109/ACCESS.2022.3214217
|
| [23] | Y. Chen, J. Yu, G. Yong, Detecting trajectory outliers based on spark, in 2017 25th International Conference on Geoinformatics, (2017), 1–5. https://doi.org/10.1109/GEOINFORMATICS.2017.8090919 |
| [24] | K. Hu, P. Duan, B. Hu, Q. Duan, IBTOD: An isolation-based method to detect outlying sub-trajectories on multi-factors, in IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference, 2018. https://doi.org/10.1109/IMCEC.2018.8469416 |
| [25] | A. Belhadi, Y. Djenouri, C. Lin, Comparative study on trajectory outlier detection algorithms, in 2019 International Conference on Data Mining Workshops (ICDMW), (2019), 415–423. https://doi.org/10.1109/ICDMW.2019.00067 |
| [26] |
R. Maria, P. Giuliana, V. Michele, Maritime anomaly detection: A review, Wiley Interdiscip. Rev. Data Mining Knowl. Discovery, 8 (2018), 8. https://doi.org/10.1002/widm.1266 doi: 10.1002/widm.1266
|
| [27] | S. Papadimitriou, H. Kitagawa, P. Gibbons, C. Faloutsos, LOCI: fast outlier detection using the local correlation integral, in Proceedings 19th International Conference on Data Engineering, 2003,315–326. https://doi.org/10.1109/ICDE.2003.1260802 |
| [28] |
G.Pallotta, M.Vespe, K.Bryan, Vessel pattern knowledge discovery from AIS data: A framework for anomaly detection and route prediction, Entropy, 15 (2013), 2218–2245. https://doi.org/10.3390/e15062218 doi: 10.3390/e15062218
|
| [29] | W.Dai, C.Zhang, X.Su, S. Cao, Trajectory Outlier Detection Based on DBSCAN and Velocity Entropy, in 2020 International Conferences on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) and IEEE Congress on Cybermatics (Cybermatics), (2020), 550–557. https://doi.org/10.1109/iThings-GreenCom-CPSCom-SmartData-Cybermatics50389.2020.00097 |
| [30] | Z. Cheng, C. Zou, J. Dong, Outlier detection using isolation forest and local outlier factor, in Proceedings of the Conference on Research in Adaptive and Convergent Systems, (2019), 161–168. https://doi.org/10.1145/3338840.3355641 |
| [31] | F. Luan, Y. Zhang, K. Cao, Q. Li., Based local density trajectory outlier detection with partition-and-detect framework, in 2017 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD), (2017), 1708–1714. https://doi.org/10.1109/FSKD.2017.8393023 |
| [32] | T. Fei, M. Kai, Z. Zhou, Isolation forest, in Proceedings of the 2008 Eighth IEEE International Conference on Data Mining, (2008), 413–422. https://doi.org/10.1109/ICDM.2008.17 |
| [33] | Historical AIS Data Services (accessed on 10 December 2018). Available from: http://www.vtexplorer.com/ |
| [34] |
C. Iphar, C. Ray, A. Napoli, Data integrity assessment for maritime anomaly detection, Expert Syst. Appl., 147 (2020), 3. https://doi.org/10.1016/j.eswa.2020.113219 doi: 10.1016/j.eswa.2020.113219
|
| [35] | H. Liu, Y. Liu, Z. Zong, Research on ship abnormal behavior detection method based on graph neural network, in 2022 IEEE International Conference on Mechatronics and Automation (ICMA), (2022), 834–838. https://doi.org/10.1109/ICMA54519.2022.9856198 |
| [36] | G. Huang, S. Lai, C. Ye, H. Zhou, Ship trajectory anomaly detection based on multi-feature fusion, in 2021 IEEE International Conference on Smart Data Services (SMDS), (2021), 72–81. https://doi.org/10.1109/SMDS53860.2021.00020 |
Figures(16) / Tables(4)
Lixiang Zhang, Yian Zhu, Jie Ren, Wei Lu, Ye Yao. A method for detecting abnormal behavior of ships based on multi-dimensional density distance and an abnormal isolation mechanism[J]. Mathematical Biosciences and Engineering, 2023, 20(8): 13921-13946. doi: 10.3934/mbe.2023620
DownLoad: