Privacy protection in computer communication is gaining attention because plaintext transmission without encryption can be eavesdropped on and intercepted. Accordingly, the use of encrypted communication protocols is on the rise, along with the number of cyberattacks exploiting them. Decryption is essential for preventing attacks, but it risks privacy infringement and incurs additional costs. Network fingerprinting techniques are among the best alternatives, but existing techniques are based on information from the TCP/IP stack. They are expected to be less effective because cloud-based and software-defined networks have ambiguous boundaries, and network configurations not dependent on existing IP address schemes increase. Herein, we investigate and analyze the Transport Layer Security (TLS) fingerprinting technique, a technology that can analyze and classify encrypted traffic without decryption while addressing the problems of existing network fingerprinting techniques. Background knowledge and analysis information for each TLS fingerprinting technique is presented herein. We discuss the pros and cons of two groups of techniques, fingerprint collection and artificial intelligence (AI)-based. Regarding fingerprint collection techniques, separate discussions on handshake messages ClientHello/ServerHello, statistics of handshake state transitions, and client responses are provided. For AI-based techniques, discussions on statistical, time series, and graph techniques according to feature engineering are presented. In addition, we discuss hybrid and miscellaneous techniques that combine fingerprint collection with AI techniques. Based on these discussions, we identify the need for a step-by-step analysis and control study of cryptographic traffic to effectively use each technique and present a blueprint.
Citation: Sunghyun Yu, Yoojae Won. A survey of methods for encrypted network traffic fingerprinting[J]. Mathematical Biosciences and Engineering, 2023, 20(2): 2183-2202. doi: 10.3934/mbe.2023101
Related Papers:
[1]
Pin Lv .
Evaluation of biomedical industry technological innovation ability based on a grey panel clustering model. Mathematical Biosciences and Engineering, 2023, 20(1): 1538-1557.
doi: 10.3934/mbe.2023070
[2]
Xiaoshan Qian, Lisha Xu, Xinmei Yuan .
Soft-sensing modeling of mother liquor concentration in the evaporation process based on reduced robust least-squares support-vector machine. Mathematical Biosciences and Engineering, 2023, 20(11): 19941-19962.
doi: 10.3934/mbe.2023883
[3]
Yongfeng Yin, Routing Zhang, Qingran Su .
Threat assessment of aerial targets based on improved GRA-TOPSIS method and three-way decisions. Mathematical Biosciences and Engineering, 2023, 20(7): 13250-13266.
doi: 10.3934/mbe.2023591
[4]
Peng Zheng, Jingwei Gao .
Damping force and energy recovery analysis of regenerative hydraulic electric suspension system under road excitation: modelling and numerical simulation. Mathematical Biosciences and Engineering, 2019, 16(6): 6298-6318.
doi: 10.3934/mbe.2019314
[5]
Qiwen Wang, Guibao Song, Xiuxia Yang .
Mixed-attitude three-way decision model for aerial targets: Threat assessment based on IF-VIKOR-GRA method. Mathematical Biosciences and Engineering, 2023, 20(12): 21514-21536.
doi: 10.3934/mbe.2023952
[6]
Murtaza Ahmed Siddiqi, Celestine Iwendi, Kniezova Jaroslava, Noble Anumbe .
Analysis on security-related concerns of unmanned aerial vehicle: attacks, limitations, and recommendations. Mathematical Biosciences and Engineering, 2022, 19(3): 2641-2670.
doi: 10.3934/mbe.2022121
[7]
Andrew L. Nevai, Richard R. Vance .
The role of leaf height in plant competition for sunlight: analysis of a canopy partitioning model. Mathematical Biosciences and Engineering, 2008, 5(1): 101-124.
doi: 10.3934/mbe.2008.5.101
[8]
Jun Gao, Fei Wu, Yakufu Yasen, Wanqing Song, Lijia Ren .
Generalized Cauchy process based on heavy-tailed distribution and grey relational analysis for reliability predicting of distribution systems. Mathematical Biosciences and Engineering, 2022, 19(7): 6620-6637.
doi: 10.3934/mbe.2022311
[9]
Yunhui Zhang, Yongquan Zhou, Shuangxi Chen, Wenhong Xiao, Mingyu Wu .
Bald eagle search algorithm for solving a three-dimensional path planning problem. Mathematical Biosciences and Engineering, 2024, 21(2): 2856-2878.
doi: 10.3934/mbe.2024127
[10]
Peter W. Bates, Jianing Chen, Mingji Zhang .
Dynamics of ionic flows via Poisson-Nernst-Planck systems with local hard-sphere potentials: Competition between cations. Mathematical Biosciences and Engineering, 2020, 17(4): 3736-3766.
doi: 10.3934/mbe.2020210
Abstract
Privacy protection in computer communication is gaining attention because plaintext transmission without encryption can be eavesdropped on and intercepted. Accordingly, the use of encrypted communication protocols is on the rise, along with the number of cyberattacks exploiting them. Decryption is essential for preventing attacks, but it risks privacy infringement and incurs additional costs. Network fingerprinting techniques are among the best alternatives, but existing techniques are based on information from the TCP/IP stack. They are expected to be less effective because cloud-based and software-defined networks have ambiguous boundaries, and network configurations not dependent on existing IP address schemes increase. Herein, we investigate and analyze the Transport Layer Security (TLS) fingerprinting technique, a technology that can analyze and classify encrypted traffic without decryption while addressing the problems of existing network fingerprinting techniques. Background knowledge and analysis information for each TLS fingerprinting technique is presented herein. We discuss the pros and cons of two groups of techniques, fingerprint collection and artificial intelligence (AI)-based. Regarding fingerprint collection techniques, separate discussions on handshake messages ClientHello/ServerHello, statistics of handshake state transitions, and client responses are provided. For AI-based techniques, discussions on statistical, time series, and graph techniques according to feature engineering are presented. In addition, we discuss hybrid and miscellaneous techniques that combine fingerprint collection with AI techniques. Based on these discussions, we identify the need for a step-by-step analysis and control study of cryptographic traffic to effectively use each technique and present a blueprint.
1.
Introduction
Achieving low carbon and zero discharge of hazardous chemicals in transportation is of vital importance to society. The new round of global scientific and technological revolution and industrial change is developing vigorously, and the automobile industry has entered an era of unprecedented changes in a century, accelerating the integration of automobiles with information and communication, energy and other fields. In the face of challenges, relevant countries have strengthened the overall planning, carry out systematic layouts, and strive to seize the opportunity to promote industrial development to a new level. In order to seize the major strategic opportunity of carbon neutral carbon peak, accelerate the transformation and upgrading of the automobile industry into electric, networked and intelligent, and promote the high-quality and sustainable development of the new energy vehicle industry in Jiangsu Province, according to the Notice of the General Office of the State Council on the Issuance of the Development Plan of New Energy Vehicle Industry (2021–2035) (Guo Ban Fa [2020] No. 39) and the "Jiangsu Province The 14th Five-Year Plan for National Economic and Social Development and the Outline of the 2035 Vision", Jiangsu Province has also issued the "14th Five-Year Plan for the Development of New Energy Vehicle Industry in Jiangsu Province", which is an important guiding significance for the future development of the industry.
As an important part of the Yangtze River Delta, Jiangsu Province has achieved excellent industrial scale and economic benefits in the field of new energy, but it still lacks technological innovation and industrial competitiveness in the development of the new energy vehicle industry. Therefore, to promote the sustainable development of Jiangsu's NEV industry and further enhance national competitiveness, it is necessary to evaluate the competitiveness and analyze the problems during development. This study first selects the competitiveness evaluation index in literatures to construct the competitiveness evaluation index system of the NEV industry in Jiangsu Province, constructs a grey relevancy clustering model based on a three-way decision, evaluates the new energy of Jiangsu province assesses the development level and problems of China's new energy vehicle industry competitiveness, and gives countermeasure suggestions for the improvement of China's new energy vehicle industry competitiveness.
2.
Related literatures
NEVs refer to vehicles that use unconventional energy sources such as solar energy, wind energy, biomass energy, and electric energy converted from them as vehicle fuels, and use driving technologies and structures that are different from traditional vehicles to drive vehicles. China first proposed the concept of NEVs in the "863 plan" at the beginning of the "Eleventh Five-Year Plan" period, and has since attracted the attention of scholars. In a broad sense, NEVs include all vehicles that consume "new" energy. The "new" energy that currently drives cars can be electric energy, solar energy, and natural gas, such as new fuel cell, electric vehicles, hybrid electric vehicles, and pure electric vehicles. Fuel cell vehicles are superior to battery-pack electric vehicles in terms of quality, volume, cost, primary greenhouse gas emission reduction, and fuel filling time. In a narrow sense, a NEV is a vehicle that uses new energy as a power device and is manufactured with superb technology and structural equipment. In short, NEVs mainly refer to vehicles driven by new energy sources, including three main forms of pure electric vehicles, plug-in hybrid electric vehicles and fuel cell vehicles.
In the field of new energy competitiveness research, Zhan analyzed the competitiveness development of Fujian's new energy automobile industry based on the "diamond model" [1]. Yuan et al. analyzed China's new energy vehicle industry in terms of advantages, disadvantages, opportunities and challenges, and proposed to improve the competitiveness of China's new energy vehicle industry by strengthening publicity and other means [2]. Yan constructed the evaluation system of Beijing's new energy industry competitiveness from four dimensions: industrial innovation ability, market development ability, industrial strategic ability and industrial environment construction, and conducted quantitative research based on the analytic hierarchy process fuzzy comprehensive evaluation method. According to the evaluation results, he proposed countermeasures and suggestions to strengthen the competitiveness of Beijing's new energy industry from four aspects: law and regulation construction, innovation mechanism, industrial upgrading and regional coordination [3]. Yang et al. evaluated the competitiveness of Hebei's new energy industry from six aspects: foundation, technology, personnel, economy, environment and market [4]. In addition, scholars have made some achievements in the field of studying the evaluation index of the competitiveness of the new energy industry. Zhuang et al. analyzed the current situation of the international competitiveness of China's automotive industry from the perspective of the global value chain through four segments: the research and development segment, the production segment, the sales segment, and the after-sales service segment [5]; Wang & Wang used the number of research and development institutions, the proportion of invested funds and talents to measure the strength and potential of the industry from the perspective of patent development [6]. Subsequently, scholars believe that the results reflected by a single dimension are too one-sided and subjective, and should be measured from multiple dimensions, such as "energy efficiency and environmental protection industrial base economic applicability facility dependence" [7], "effective competition innovation capability industrial chain cooperation" [8]. Subsequently, in order to better understand the business model innovation path of new energy vehicles, Zhang et al. added a business model layer on the basis of the three-layer framework of macro environment, system and technological niche, built a business model innovation path model from a multi-level perspective, and analyzed five typical business model innovation paths [9]. With the continuous maturity of the new energy vehicle market, people's understanding of the supply side and the demand side has gradually deepened, and the indicators related to the supply side and the demand side have also started to be included in the evaluation system when assessing the competitiveness of the new energy vehicle industry, such as the environmental and energy benefits and vehicle penetration rates of plug-in hybrid and electric vehicles [10], indicators such as total cost of hybrid vehicles, industrial policies and inter-industry cooperation [11].
There are many influencing factors for the development of the NEV industry, mainly in financial subsidies, government policies, related industry support, and technological innovation. Ma et al. [12] found that the positive cointegration relationship among market share, purchase subsidy, and tax exemption has an impact on the development of the NEV industry. Gong analyzed the factors influencing the international competitiveness of China's new energy automobile industry by using Porter's "diamond model" analysis method, comprehensively combed the advantages and disadvantages of China's new energy automobile industry development, and found the right focus for improving China's new energy automobile industry's international competitiveness. The research shows that China's new energy automobile industry has obvious competitive advantages in terms of global market share, industrial chain integrity, and the number of self-owned brand automobile enterprises, etc., but there are deficiencies in international market expansion, some key technologies, industrial service support, high-end brand recognition [13]. Kim & Eun found that a country's petroleum resource endowment is negatively correlated with automotive technological innovation, and the price of energy is related to NEV technology and energy improvement [14].
Regarding policy, Liu & Song [15] found that the core technology innovation policies in China and other countries have both invested considerable amounts in technology R & D (research and development). However, China's industrial policies have not been able to provide relevant companies with a good development environment and advanced technology [16]. China's NEV industry policy focuses on complete vehicles and is relatively contemptuous of raw materials and parts, causing an imbalance in the technological level of the industry's upstream and downstream [17]. In addition, scientific and technological services play a pivotal role in the scientific and technological innovation of the NEV industry and the transformation of scientific results. Supporting services of university libraries are essential to enhance the scientific and technological innovation capabilities of universities [18]. Ji et al. also studied how to promote the development and popularization of new energy vehicles and how to alleviate the financial pressure faced by the government [19].
According to the above discussion and analysis, there are still problems in the evaluation of the competitiveness level of the new energy vehicle industry. 1) The indicators for evaluating the level of competitiveness need to be improved. At present, there are relatively few studies on the development trend and evaluation of the competitiveness of emerging innovative industries. Most of the existing studies discuss and analyze them as a whole, without making clear distinction between the correlation and levels of indicators, and without forming a set of structural and complete evaluation systems. 2) The measurement method of competitiveness level needs to be improved. At present, the evaluation of the competitiveness of the NEV industry is mostly based on the diamond model, principal component analysis model, fuzzy comprehensive evaluation, grey relational analysis, cluster analysis and other methods [20,21]. These methods can qualitatively and quantitatively analyze the competitiveness of the NEV industry. However, the actual operation process is highly subjective, and there is no in-depth quantitative analysis of complex panel data including time and space dimensions. At the same time, considering that the evaluation of the new energy vehicle industry is a multi-attribute, multi-stage and multi-object panel data evaluation problem, in order to solve these problems, this paper uses panel data, grey correlation clustering analysis and three-way decision-related methods to build an evaluation method suitable for the characteristics of the new energy vehicle industry, and more reasonably measure the competitiveness of new energy vehicles in Jiangsu Province.
3.
Competitiveness index system construction
The core issue of the evaluation of the competitiveness of the new energy vehicle industry in Jiangsu Province is to construct a new energy vehicle industry competitiveness evaluation index system. In this paper, the evaluation index system of the competitiveness of the new energy vehicle industry is constructed by combining the theories of industrial competitiveness and the characteristics of the new energy vehicle industry. The evaluation index system of the competitiveness of the new energy vehicle industry is completed by combining the theories related to industrial competitiveness and the characteristics of the new energy vehicle industry with the evaluation index systems of the traditional automobile industry and the new energy vehicle industry. The whole process consists of two parts, firstly, the selection of evaluation indexes, and secondly, the allocation of weights.
3.1. Basic ideas
The basic idea for the construction of the evaluation index system of the competitiveness of the new energy vehicle industry in this paper is: after getting familiar with the relevant theories of industrial competitiveness, comprehensively consider the characteristics of the new energy vehicle industry and the existing comprehensive evaluation index system of the competitiveness of the traditional automobile industry, and initially establish a comprehensive evaluation index system of the competitiveness of the new energy vehicle industry. In order to describe the characteristics, structure and element composition of the object more objectively, this paper establishes an evaluation index system based on the five principles of objectivity, comparability, scientificity, availability and systematicness, and the influencing factors and essential characteristics of the competitiveness of the new energy industry. The new energy industry competitiveness evaluation index system needs to be constructed from different angles and levels. The selected evaluation indicators cover the characteristics of the competitiveness of the new energy industry as much as possible, and objectively and comprehensively describe the development of the competitiveness of the new energy industry in Jiangsu Province.
3.2. Weight measurement methods
Another key aspect of the comprehensive evaluation of the competitiveness of the new energy vehicle industry is the determination of the index weights, and the reasonableness of the weight system affects the accuracy and objectivity of the evaluation results. In order to get more comprehensive index weights, both subjective and objective factors have to be considered. Therefore, compared with the previous traditional expert scoring method, this paper adopts the AHP method [22] and entropy weight method [23] to calculate the subjective weights and objective weights of evaluation indicators, respectively, and the specific calculation process can be referred to the literature [22,23], which will not be repeated here.
3.3. Selection of evaluation indexes and model constructions
Combined with the existing excellent academic master's thesis and core journal evaluation indexes in the evaluation of the competitiveness of the new energy vehicle industry as shown in Table 1.
Table 1.
Evaluation indicators for competitiveness of new energy vehicle industry.
year
author
evaluation indexes
2004
Research Group on "China's Industrial Competitiveness", Renmin University of China [24]
7 primary indicators of competitive strength, growth competitiveness, market competitiveness, cost competitiveness, innovation competitiveness, investment competitiveness and management competitiveness and 49 other secondary indicators.
5 primary indicators of environmental competitiveness, innovation competitiveness, manufacturing competitiveness, parts competitiveness and market competitiveness and 19 other secondary indicators.
6 first-level indicators of government behavior, demand conditions, production factors, relevant support industries, competitors in the same industry and technology-based indicators and 14 other secondary indicators.
5 primary indicators of basic competitiveness, industrial support, display competitiveness, enterprise competitiveness and product competitiveness and 18 other secondary indicators.
4 primary indicators of environmental competitiveness, market competitiveness, production competitiveness and international competitiveness and 16 other secondary indicators.
Percentage of new energy vehicle sales, annual sales of private charging posts, national per capita disposable income, age share of population aged 25–44, number of school students per 100,000 population.
In this paper, considering the characteristics of the new energy vehicle industry, the existing comprehensive evaluation index system of the competitiveness of the traditional automobile industry, the representativeness of the indexes and the collectability of data, 26 indexes were selected from seven dimensions: demand competitiveness, infrastructure competitiveness, industrial agglomeration, industrial competition, industrial innovation, pillar industries and government policies, and a preliminary evaluation index system of the competitiveness of the new energy vehicle industry in Jiangsu Province was established as shown in Table 2, so as to evaluate the competitiveness of the new energy vehicle industry in Jiangsu Province.
Table 2.
Evaluation Index System of NEV Industry Competitiveness.
First level indicator
Secondary indicator
Weight
Demand competitiveness
Per capita disposable income (yuan)
0.035
Regional GDP per capita (yuan)
0.048
Private car ownership (10,000 units)
0.042
NEV industry vehicle output (10,000 units)
0.041
NEV sales (10,000 units)
0.049
Infrastructure competitiveness
Automobile-related major colleges (institutes) (number of undergraduate colleges)
0.039
Public charging (exchanging) station and pile (10,000 seats)
0.041
Industrial agglomeration
Number of enterprises above designated size
0.037
Total assets of NEV industry (100 million)
0.035
NEV industry output value (100 million)
0.068
Regional GDP
0.04
Average number of employees in the NEV industry (10,000 people)
0.032
NEV export volume (10,000 units)
0.037
Industrial competition
Market share
0.034
Profit ratio of sales
0.032
Growth rate of the number of enterprises above designated size
0.039
Number of NEV companies (ten thousand)
0.031
Industrial innovation
NEV patent applications
0.047
Proportion of high-level employees
0.033
Total output value of new industrial products (100 million yuan)
0.032
NEV technology research and development expenses (100 million yuan)
0.028
Supporting industries
Number of supporting enterprises
0.041
Total output value of supporting enterprises (100 million yuan)
Demand competitiveness refers to consumers' demand for NEV products and services in the region. Sufficient demand is the endogenous power for companies to improve product services. The most classic theory for industry competitiveness evaluation is Porter's diamond model, which regards trial production requirements, demand conditions, related industry support, and competition in the industry as key factors, and meanwhile summarizes government actions and opportunities as an external auxiliary factors. Regional total output value per capita and per capita disposable income are a reflection of regional economic strength, economic vitality, and people's consumption ability. The new energy vehicle industry is not a defense-military industry, and the development of the new energy industry relies mostly on the purchase volume of private consumers; China has set a mandatory roll-out schedule for traditional fuel cars, and the private car ownership is the replacement volume of potential new energy vehicles [20]. Industrial scale is the basis of industrial development, only a certain amount of asset accumulation and fixed asset investment can continuously and steadily expand the production scale and maintain a certain level of output and competitiveness, the higher the output, the larger the industrial scale, the more likely it is to achieve economies of scale and enhance the competitive advantage of the industry, so the production capacity of new energy vehicles in a region can be measured by the output of new energy vehicle industrial vehicles [26,30]. NEV sales refer to the actual sales volume of NEVs in the region, which can also measure the competitive ability of regional new energy vehicles to a certain extent [31]. Therefore this study selected per capita disposable income, regional GDP, per capita, private car ownership, NEV industry, vehicle output, and NEV sales as secondary indicators of demand competitiveness.
3.3.2. Infrastructure competitiveness
Infrastructure competitiveness refers to the basic competitiveness that the resource endowment conditions relate to the NEV industry, while abundant infrastructure and human resources indicate greater competitiveness. New energy charging infrastructure and vehicle promotion and application are greatly related, and the delay in the development of the layout of charging piles will hinder the promotion of new energy vehicles. 2020 government also made it clear that the construction and popularization of charging facilities will be the focus of support for the new energy vehicle industry during the 14th Five-Year Plan. Talent is a strategic resource and a decisive factor for economic and social development. The number of colleges and universities with automobile majors directly determines the number of higher education talents in automobile majors in a region. More colleges and universities indicate stronger talent-based competitiveness in the region and richer human resources for industrial development. The number of universities with automotive-related majors reflects the basic competitiveness of talents in a region [20]. Richer infrastructure and human resources indicate stronger competitiveness. This study selects the number of auto-related professional colleges, public charging (exchange) stations, and the number of piles as the measurement indicators of basic competitiveness [20,31].
3.3.3. Industrial agglomeration
Industrial agglomeration is caused by the differences in resource endowment between regions and the external effects of industrial agglomeration. Therefore, indicators representing the degree of industrial agglomeration are selected to reflect regional competitiveness. This paper selects the number of enterprises above the designated size, the total assets of the NEV industry, the output value of the NEV industry, the regional GDP, the average number of employees in the NEV industry and the export volume of NEVs reflecting the degree of industrial agglomeration [20,21,31]. The number of enterprises above the designated size is used to reflect the number of core enterprises in the NEV industry of a region [21]. The total assets of the NEV industry refer to the accumulation of assets of all enterprises engaged in the NEV industry in a region [21]; the output value of the NEV industry refers to the annual total output value of the new energy industry in a region; the regional GDP is used to measure the economic level of a region, and this indicator indirectly reflects the concentration of NEVs in a region [21]; the average number of employees in the NEV industry refers to the average value of the total number of employees in the industry [21]; the export volume of NEVs is the volume of foreign exports, reflecting the international competitiveness of the NEV industry in a region [21].
3.3.4. Industrial competition
Industrial competition refers to the overall competitive situation of the NEV industry in the region. This study selects market share and sales profit rates, the growth rate of the number of enterprises above the designated size, and the number of NEV enterprises are the measurement indicators of the degree of industrial competition [20,21,30]. Industrial market share refers to the ratio of the main business income of the NEV industry to the main business income of the automobile industry, reflecting the industry market share [21]; the sales profit rate refers to the NEV industry's ratio of total profit to the main business income of the NEV industry. This indicator indirectly reflects the degree of competition in the industry [21]; the growth rate of the number of enterprises above the designated size reflects the change in the number of enterprises, The degree of competition [21]; the number of new energy companies refers to all NEV companies included in a region, reflecting the degree of industrial competition within the region [20].
3.3.5. Industrial innovation
Industrial innovation power refers to the creative ideas produced by enterprises in the region during the production of NEVs and their ability to transform them into creative products. This study selects the number of NEV patent applications, the proportion of high-level employees, the total output value of new industrial products, and the R & D cost of NEV technology to measure industry innovation [13,21,26,31]. The number of NEV patent applications and the proportion of high-level employees; the total output value of new industrial products reflects the innovation level of the NEV industry [21]; the NEV technology R & D costs were accumulated funds invested in the R & D process, reflecting the level of regional R & D investment [31].
3.3.6. Supporting industries
Supporting industry refers to the development status of industries related to the development of the NEV industry in the cluster area. The supporting industries for NEVs mainly include the battery industry, the electric motor industry, and the electronic control system industry. The development of the new energy battery industry directly affects the safety and endurance of NEVs. The energy storage status of the chips required by the electronic control system is directly related to the energy storage of NEVs. This paper selects the number of supporting companies, the total output value of supporting companies, and the number of NEV experience stores as the measurement indicators for the pillar industries [20,21,31]. The number of supporting enterprises and the total output value of supporting enterprises directly reflect the strength of the relevant supporting industries in the region; the NEV experience store is an offline entity for end consumers, showing consumers the high-tech, policy preferences, service guarantee and other functions of NEVs, and is an important way to support consumer purchases, so the number of offline experience stores is selected to measure the status of supporting industries [21].
3.3.7. Government policy
Government policy competitiveness refers to the policy support formulated by the local government to promote the development of the local NEV industry, including government capital investment, subsidies for NEV companies, and tax relief. This paper selects government capital investment and tax reduction and exemption policies as the measure of government policy competitiveness [20,21]. Government investment refers to the policy support funds accumulated by the regional government to promote the development of the NEV industry [20,21]. The tax reduction and exemption policy is the number of special policies provided by the local government for enterprises engaged in the NEV industry [20]. These two indicators are used to measure the degree of government support for the NEV industry.
4.
Research methods
Grey relevancy clustering is a method of classifying research objects according to their degree of association. Liu et al. [32] pointed out that there are a large number of practical and scientific problems in reality, which urgently need to be studied using high-dimensional data such as panel data. Therefore, correlation modeling and clustering analysis of panel data are very valuable research directions. Among the clustering methods under panel data, grey relevancy clustering has the advantage of not requiring a high sample size and time length. At present, the evaluation of the competitiveness of the NEV industry is mostly based on the diamond model, principal component analysis model, fuzzy comprehensive evaluation, grey relational analysis, cluster analysis and other methods [20,21]. These methods can qualitatively and quantitatively analyze the competitiveness of the NEV industry. However, these methods are highly subjective in practice and have a single form, which cannot fully exploit the information contained in the panel data and have low credibility. The grey clustering method has a great advantage in dealing with the "information-poor" clustering problem. The comprehensive evaluation using cluster analysis can classify the object categories and attributes by combining the spatial and temporal attributes of the panel data. Therefore, based on the theory of three-way decision-making, this study combines the grey correlation analysis method and constructs a grey correlation clustering method for panel data based on three-way decision-making to accurately grasp the differences and characteristics of different attributes of the research objects, to more reasonably evaluate the competitiveness of the new energy vehicle industry in Jiangsu Province, and to improve the timeliness of policies and programs.
Panel data is a more complex form of data structure. It is the repeated observations of the nodes of the research object in different periods on the cross-section. It also contains cross-sectional data and time series, and has the characteristics of two dimensions of space and time. There is a decision-making information system based on panel data , where is the cluster object collection; is the index collection; is the panel data range, where vijt is the cluster object i's observation value about the index j at the time t, and represents the object's spatiotemporal feature attribute collection.
Definition 1. Suppose xij(t) is the dimensionless measurement value of the index value vtij of the index j(j=1,2,…,m) of the time object i(i=1,2,…,N) at time t(t=1,2,…,T). For i=1,2,…,n;j=1,2,…,m;t=1,2,…T, if Δxij(t),ˉxi(j) and Si(j) respectively represent the increment of the index j of the object i at time t, the mean value and standard deviation of the index j, and satisfy , we called the matrix
the absolute level matrix, incremental level matrix, and volatility level matrix under panel data for the object i, respectively.
Among them, .
This paper sets the spatiotemporal characteristics of the research object as absolute level, incremental level, and volatility level, and denoted as c1,c2,c3, then there are l=1,2,3, q=3. Suppose γijl(t) is the measured value of the spatiotemporal characteristic attribute cl of the index j at the time t of the object i, which represents the spatiotemporal characteristic attribute value of the absolute quantity level, the incremental level and the volatility level. Correspondingly, the spatiotemporal characteristic matrix can be defined.
Definition 2. Suppose γijl(t) is the measured value of the index j at the moment t under the temporal and spatial characteristics cl of the object i, and for , we called a matrix as the measure value matrix, has the characteristic property of time and space cl at the moment t about the index jl for the object i.
According to Definitions 1 and 2, it can be seen that . Larger absolute and increment levels and smaller volatility levels indicate better performance. For spatiotemporal characteristic attributes c1, the index j1 satisfies j1=1,2,…,m1 and m1=m; for spatiotemporal characteristic attributes c2, the index j2 satisfies j2=1,2,…,m2 and m2=m; for spatiotemporal characteristic attributes c3, the index j3 satisfies j3=1,2,…,m3 and m3=m, that is, j1=j2=j3=j=1,2,…,m.
For , let and respectively represent the distance between the object i and k with the index under the set of temporal and spatial feature attributes cl and time feature attributes C. The absolute, incremental level attributes, and the distance of the fluctuating level attribute of the object i and k with respect to the index can be represented with respectively. Among them, , . Smaller value indicates that the object i and the object k are more similar in terms of the index development degree; and d2jik describes the trend difference between the object i and the object k in relation to the index j(j=1,2,…,m) increase value over time. If the object i and k have the same change in the index j(j=1,2,…,m) over time, the more similar between i and k, the smaller the distance, and vice versa; d3jik characterizes the degree of volatility of the index value of the index j(j=1,2,…,m) between the object i and the object k over time. If the similarity between the two individuals is greater, the distance between the object i and the object k is smaller, then we have
(4.1)
Among them, wl represents the weight of the spatiotemporal feature attribute cl, and .
Considering that the grey relational analysis judges whether the relationship is close, according to the similarity of the geometric shape of the sequence curve, the grey relational analysis method can be used to measure the distance between the research object i and k about the relevant index j(j=1,2,…,m) under the time characteristic attribute set C. Accordingly, the grey relational coefficient of indicator j under the time characteristic attribute set C is:
(4.2)
where ρ∈(0,1).
Correspondingly, the grey relational degree of the time characteristic attribute set C between i and k is:
(4.3)
Among them, wj is the weight of the index j(j=1,2,…,m) under the time characteristic attribute set C, .
Definition 3. Suppose that dCik represents the distance of the decision-making object i,k with respect to the set of temporal and spatial characteristic attributes C. For , if is satisfied, then it is called a matrix
The relational distance matrix of multiple spatiotemporal feature attribute objects.
Definition 4.d is the distance matrix of multi-attribute feature objects. For , , if , i,k are called the same class. Correspondingly, the classification of multi-attribute feature objects under the critical value α is called the α grey relational clustering of multi-attribute feature objects. α can be determined according to the needs of the actual problem. The closer α is to 1, the finer the classification, and there are fewer objects in each component; smaller α indicates coarser classification, and there are more variables in each component. Generally, α = 0.5.
The clustering threshold of the clustering method based on grey relational analysis is generally given by the decision maker in advance, so it is highly subjective and lacks scientific rationality. In addition, in actual situations, objects do not only belong to a certain set (category) and do not belong to a certain set (category). There are also objects between belonging to a certain set and not belonging to a certain set. Therefore, to more scientifically and reasonably reflect the category of the object and discuss the threshold, this paper draws on the three decision-making theories and introduces two parameters α, β into the grey relational clustering model.
Definition 5 supposes there is a multitemporal feature attribute decision clustering problem. For , the decision object has the following three possible relationships:
(1) If , the decision object i,k is the same kind of relationship.
(2) If , the decision object i,k is an uncertain relationship.
(3) If , then the decision object i,k is a non-homogeneous relationship.
Correspondingly, a set of possible relationships of objects i can be defined.
Definition 6. For , if the grey relational degree between any object k and the object i with respect to the spatiotemporal characteristic attribute set is dCik, then the classification situation of the decision object with respect to the spatiotemporal characteristic attribute set can be defined as:
(4.4)
(4.5)
(4.6)
When , the grey relational clustering method degenerates to the classical grey relational clustering method. The classic grey relational clustering method is a special case of the model constructed, and the model constructed in this study is an extension and generalization of the classic grey relational clustering.
This paper uses Bayesian decision reasoning to determine the grey relational clustering threshold α and β with the decision rough set method. For any , the corresponding loss function is generated under two states and three relations (action plans), as shown in Table 3. Regarding , the two states of the relationship are belonging to or not belonging to a category, respectively. In addition, there are three relations or action plans ; let represent the three action plans, where each means that the object must belong to the same category , may belong to the same category , and certainly do not belong to the same category ; suppose , and respectively indicate that the decision-maker adopts the loss function that belong to the same category ; and , indicate that the loss function that does not belong to the same category .
Table 3.
Loss function on state and action plan about i,k∈U.
This section may be divided by subheadings. It should provide a concise and precise description of the experimental results, their interpretation, as well as the experimental conclusions that can be drawn.
5.1. Sample
The data is by the end of 2019. Thirteen provinces with good development of NEV industry across China were selected as the sample. Data include per capita disposable income, regional GDP, per capita, regional GDP, and the number of enterprises above the designated size are from the "China Statistical Yearbook 2019" and the "2019 National Economic Development and Social Development Bulletin" of various provinces; automotive-related majors data for universities, public charging (replacement) stations, and piles are from the 2017–2019 "China Automobile Market Yearbook" and "China Electric Vehicle Charging Pile Industry Research Report"; market share, sales profit margin, and growth rate of the number of enterprises above designated size, The number of NEV companies, the number of private cars, the NEV industry's vehicle production, and the NEV sales data are derived from the data of the automobile industry statistical yearbook 2017–2019; the total assets of the NEV industry, the output value of the NEV industry, The average number of employees in the NEV industry, the export volume of NEVs, the number of supporting companies, the total output value of supporting companies, and the number of NEV experience stores are collected from the "Blue Book Series-China NEV Industry Development Report 2019"; government funds Data on investment and tax reduction and exemption policies are compiled from the official website of each province; the number of NEV patent applications, the proportion of high-level employees, the total output value of NEVs, and the NEV technology research and development expenses are derived from the new energy released by the State Intellectual Property Office An analysis report on the patent situation of the automobile industry. For the data vacancy, the exponential smoothing method is used to estimate the missing data. The data is shown in Tables S1–S3(Please find attached for more detail).
5.2. Measurement of the competitiveness level of NEV industry
The level of competitiveness of Jiangsu's NEV industry is measured with a grey relational analysis model. This paper uses AHP method and entropy method to calculate the evaluation index weights respectively, the weights of each indicator can be determined , , , . After the dimensionless processing of the above data, the data of each province under the spatiotemporal characteristic attribute set can be obtained with Eqs (4.1) and (4.2) (see Tables 4–6). According to the method of determining the weights of spatiotemporal feature attributes used by [33] to obtain spatiotemporal feature attributes, the weights are as follows: .
Table 4.
Dimensionless data of each province under the attribute of absolute quantity level.
Jiangsu
Shanghai
Beijing
Zhejiang
Hubei
Hunan
Hebei
Henan
Anhui
Fujian
Sichuan
Shandong
Guangdong
Per capita disposable income (yuan)
0.5945
1.0000
0.9725
0.7152
0.3922
0.3945
0.3664
0.3428
0.3749
0.5103
0.3515
0.4555
0.5598
Regional GDP per capita (yuan)
0.7641
0.9764
0.9826
0.6587
0.4492
0.3533
0.2991
0.3391
0.3289
0.6192
0.3290
0.4418
0.5875
Private car ownership (10,000 units)
1.0000
0.3980
0.4803
0.8783
0.4495
0.4694
0.9163
0.7606
0.6291
0.3540
0.6383
0.7749
0.6576
NEV industry vehicle output (10,000 units)
0.4468
0.7538
0.1391
0.3076
0.3792
0.4286
0.1553
0.3273
0.6835
0.1163
0.1614
0.7721
0.6131
NEV sales (10,000 units)
0.7418
0.4361
0.3850
0.5001
0.1213
0.1235
0.1868
0.2845
0.1634
0.1791
0.2255
0.3382
0.7174
Automobile-related major colleges (institutes) (number of undergraduate colleges)
0.9454
0.5299
0.9206
0.4876
0.8309
0.6263
0.7495
0.7443
0.5748
0.4807
0.6631
0.8892
0.8070
Public charging (exchanging) station and pile (10,000 seats)
0.9878
0.8469
0.8340
0.3508
0.2127
0.1285
0.2918
0.1323
0.2998
0.4344
0.1764
0.3676
0.8999
Number of enterprises above designated size
0.6265
0.6754
0.2158
0.6777
0.4997
0.8000
0.0717
0.2003
0.0123
0.0045
0.0314
0.0864
0.0941
Total assets of NEV industry (100 million)
0.8778
0.9438
1.0000
0.8973
0.6823
0.6852
0.7595
0.2515
0.1783
0.0965
0.2051
0.2164
0.2538
NEV industry output value (100 million)
0.9630
0.8705
0.8404
0.7776
0.5655
0.5457
0.5795
0.6173
0.4172
0.1262
0.2638
0.1633
0.2142
Regional GDP
0.9288
0.3364
0.3124
0.5765
0.4018
0.3673
0.3593
0.4961
0.3359
0.3677
0.4141
0.6692
1.0000
Average number of employees in the NEV industry (10,000 people)
0.9221
0.9697
0.9640
0.3147
0.5581
0.4967
0.3043
0.2043
0.2355
0.1949
0.5501
0.5650
0.5721
NEV export volume (10,000 units)
0.8861
0.9605
0.9929
0.7330
0.4990
0.4533
0.1701
0.1768
0.1227
0.0948
0.0754
0.0499
0.0744
Market share
0.9449
0.9881
0.9597
0.9518
0.5873
0.4676
0.5075
0.4434
0.3398
0.2592
0.2523
0.2728
0.2794
Profit ratio of sales
0.5921
0.9556
0.6863
0.5682
0.5472
0.8100
0.4740
0.5061
0.4166
0.4212
0.4601
0.4605
0.4609
Growth rate of the number of enterprises above designated size
0.6853
0.9656
0.6650
0.1722
-0.0816
0.1489
0.3469
0.4038
0.2850
0.2202
0.3312
0.2838
0.3257
Number of NEV companies (ten thousand)
0.8582
0.7877
0.2990
0.8566
0.9432
0.7869
0.1801
0.1738
0.0965
0.0803
0.1204
0.0929
0.1130
NEV patent applications
0.6286
0.9792
0.7394
0.5630
0.4442
0.4067
0.1462
0.0455
0.3161
0.0736
0.2702
0.2461
0.1966
Proportion of high-level employees
0.8630
0.9298
0.9733
0.7909
0.6504
0.5818
0.4382
0.3628
0.4065
0.3111
0.4096
0.3162
0.2910
Total output value of new industrial products (100 million yuan)
0.8633
0.9496
0.9486
0.9889
0.5470
0.5631
0.6324
0.6569
0.4713
0.1471
0.1957
0.1871
0.2260
NEV technology R & D expenses (100 million yuan)
0.6911
0.8455
1.0000
0.7683
0.5366
0.6091
0.4499
0.4380
0.3822
0.4748
0.4903
0.3976
0.4131
Number of supporting enterprises
0.4983
0.3949
0.7987
1.0000
0.5073
0.4388
0.6363
0.7009
0.7987
0.2013
0.2658
0.0684
0.1329
Total output value of supporting enterprises (100 million yuan)
Then we calculate the ideal value of each index under each spatiotemporal feature to obtain the distribution sequence. Among them, the ideal value of the increment level and the increment level attribute for each index is the maximum value of all provinces, and the ideal value of the volatility level attribute for each index is the minimum value.
The ideal distribution sequence at the absolute level is (1, 0.9826, 1, 0.7721, 0.7418, 0.9454, 0.9878, 0.8, 1, 0.963, 1, 0.9697, 0.9929, 0.9881, 0.9556, 0.9656, 0.9432, 0.9792, 0.9733, 0.9889, 1, 1, 1, 0.9, 1 and 0.2855).
The ideal distribution sequence at the incremental level is (0.0129, 0.0510, 0.3818, 0.4775, 0.4566, 0.5964, 0.1812, 0.2878, 0.0519, 0.4726, 0.1603, 0.5417, -0.0103, 1.4756, 0.4271, 0.6728, 0.5051, 0.2730, 0.1243, 0.3782, 0.2655, 0.3339, 0.0490 and 0.3354).
The ideal distribution sequence at the volatility level is (0, 0.002, 0, 0.0019, 0.0014, 0.0001, 0.0005, 0.0008, 0, 0.0018, 0, 0.0011, 0.0002, 0.0003, 0.0062, -2.6571, 0.0004, 0.0013, 0.0017, 0.0004, 0, 0, 0, 0.0025, 0 and 0).
The grey relational coefficients of each province under each spatiotemporal characteristic attribute were presented in Tables 7–9.
Table 7.
The grey relational coefficient under the absolute level attribute.
Jiangsu
Shanghai
Beijing
Zhejiang
Hubei
Hunan
Hebei
Henan
Anhui
Fujian
Sichuan
Shandong
Guangdong
Per capita disposable income (yuan)
0.5715
1.0000
0.9516
0.6550
0.4708
0.4718
0.4605
0.4514
0.4638
0.5248
0.4547
0.4983
0.5512
Regional GDP per capita (yuan)
0.6962
0.9582
0.9688
0.6131
0.4954
0.4554
0.4355
0.4500
0.4462
0.5868
0.4463
0.4921
0.5673
Private car ownership (10,000 units)
1.0000
0.4732
0.5100
0.8164
0.4956
0.5048
0.8660
0.6931
0.5932
0.4557
0.5992
0.7061
0.6123
NEV industry vehicle output (10,000 units)
0.4943
0.6872
0.3858
0.4385
0.4656
0.4862
0.3903
0.4457
0.6308
0.3796
0.3920
0.7035
0.5829
NEV sales (10,000 units)
0.6769
0.4895
0.4679
0.5196
0.3810
0.3816
0.3994
0.4305
0.3926
0.3971
0.4112
0.4497
0.6568
Automobile-related major colleges (institutes) (number of undergraduate colleges)
0.9082
0.5350
0.8719
0.5135
0.7618
0.5914
0.6834
0.6789
0.5598
0.5101
0.6162
0.8300
0.7370
Public charging (exchanging) station and pile (10,000 seats)
0.9779
0.7794
0.7651
0.4544
0.4072
0.3829
0.4330
0.3840
0.4358
0.4888
0.3964
0.4609
0.8438
Number of enterprises above designated size
0.5915
0.6249
0.4081
0.6266
0.5194
0.7300
0.3681
0.4034
0.3538
0.3520
0.3583
0.3718
0.3738
Total assets of NEV industry (100 million)
0.8157
0.9059
1.0000
0.8404
0.6299
0.6321
0.6921
0.4195
0.3969
0.3744
0.4049
0.4083
0.4202
NEV industry output value (100 million)
0.9359
0.8068
0.7721
0.7086
0.5545
0.5435
0.5626
0.5856
0.4813
0.3823
0.4235
0.3926
0.4076
Regional GDP
0.8836
0.4490
0.4402
0.5608
0.4748
0.4609
0.4577
0.5176
0.4488
0.4610
0.4800
0.6205
1.0000
Average number of employees in the NEV industry (10,000 people)
0.8741
0.9469
0.9376
0.4411
0.5503
0.5180
0.4374
0.4046
0.4143
0.4018
0.5459
0.5542
0.5583
NEV export volume (10,000 units)
0.8260
0.9319
0.9871
0.6695
0.5191
0.4973
0.3945
0.3965
0.3813
0.3740
0.3690
0.3627
0.3688
Market share
0.9075
0.9785
0.9306
0.9182
0.5672
0.5039
0.5234
0.4928
0.4503
0.4220
0.4197
0.4265
0.4287
Profit ratio of sales
0.5701
0.9241
0.6329
0.5560
0.5443
0.7400
0.5069
0.5226
0.4811
0.4830
0.5004
0.5006
0.5008
Growth rate of the number of enterprises above designated size
0.6322
0.9402
0.6175
0.3951
0.3333
0.3885
0.4530
0.4756
0.4306
0.4095
0.4471
0.4302
0.4451
Number of NEV companies (ten thousand)
0.7923
0.7180
0.4355
0.7904
0.9049
0.7173
0.3974
0.3956
0.3744
0.3703
0.3807
0.3735
0.3788
NEV patent applications
0.5929
0.9629
0.6748
0.5531
0.4932
0.4768
0.3878
0.3617
0.4416
0.3686
0.4256
0.4177
0.4023
Proportion of high-level employees
0.7979
0.8851
0.9530
0.7211
0.6073
0.5639
0.4905
0.4591
0.4768
0.4398
0.4781
0.4416
0.4327
Total output value of new industrial products (100 million yuan)
0.7982
0.9147
0.9133
0.9799
0.5442
0.5531
0.5953
0.6118
0.5056
0.3880
0.4021
0.3995
0.4113
NEV technology research and development expenses (100 million yuan)
0.6364
0.7778
1.0000
0.7001
0.5385
0.5804
0.4957
0.4904
0.4668
0.5073
0.5148
0.4731
0.4795
Number of supporting enterprises
0.5187
0.4719
0.7288
1.0000
0.5232
0.4907
0.5979
0.6438
0.7288
0.4037
0.4242
0.3673
0.3841
Total output value of supporting enterprises (100 million yuan)
Considering the weight of each indicator, the grey relational degree of each province to the ideal object under each spatiotemporal characteristic attribute can be obtained in Table 10.
Table 10.
The grey relational degree of each province under each spatiotemporal characteristic attribute.
Under the absolute level of temporal and spatial characteristics, the development of Jiangsu's NEV industry is in a leading position in the country. The development level is relatively close to that of Beijing and Shanghai under the absolute level. Jiangsu has a good foundation for the development of the NEV industry, a solid foundation of science and technology talent, clear policy support, and a relatively high level of regional wealth. These are the powerful driving forces supporting the development of the NEV industry. Jiangsu should strengthen its emphasis on the NEV industry, strengthen policy support, improve the construction of supporting facilities for talent, ensure the sustainable and healthy development of Jiangsu's NEV industry, stabilize the first echelon of domestic NEV industry development, and create an internationalization industry.
Under the incremental level of spatiotemporal characteristic attributes, Jiangsu's incremental level ranks among the upper and middle reaches of 13 provinces, second only to Shanghai. During 2017–2019, Jiangsu's NEV industry has been in a state of rapid development, and the incremental level of the industry has also been maintained at a relatively high level. The rapid development of Jiangsu's NEV industry is inseparable from various measures taken by the provincial government during 2017–2019. For example, based on the foundation of industrial development, focusing on the development of electronic information and equipment, manufacturing industries related to the NEV industry, and building NEVs complete vehicle and parts industry clusters. However, although Jiangsu's incremental development level remains at the forefront of China, there is still a big gap between the scale, number, and internationalization level of NEV companies introduced in the development process in Jiangsu. To develop Shanghai's NEV industry, Jiangsu should build on the existing resource advantages of the province, integrate the new energy upstream and downstream industrial chain, and create a NEV industry with Jiangsu characteristics.
Under the volatility level, Jiangsu's industrial development fluctuates greatly, and the level of volatility lies in the middle reaches of the country, which is far from Shanghai. Provinces with small development volatility can be divided into two types. One is that the early development level is low, and the later development level is also low. Therefore, the overall development of the industry does not show large volatility; another is that the early-stage development level is relatively high, and the later stage development level is also maintained at a relatively high level, so the overall development level of the industry has not seen major volatility. Shanghai is clearly in the second category. Its NEV industry has been maintained at a relatively high level of development, so the volatility level of industrial development is relatively low. The high level of volatility in Jiangsu indicates that, on the one hand, Jiangsu's support for the development of the NEV industry lags behind Shanghai. On the other hand, after realizing the importance of the NEV industry, Jiangsu has intensified its efforts to cultivate the industry. The policy support has been improved, so the development of the NEV industry remained at a relatively high level in 2017–2019. For Jiangsu, it should continue to strengthen support for the development of the NEV industry, improve innovation, management and optimization services, promote the development of NEV technology and industry integration, and maintain the rapid development of the NEV industry.
From the perspective of overall temporal and spatial characteristics, Jiangsu's overall industrial development level is in the first echelon of China, second only to Shanghai and Beijing, indicating that Jiangsu's overall development level of the NEV industry is relatively good. Meanwhile, among the sub-attributes of temporal and spatial characteristics, Jiangsu's absolute and incremental development levels are still at the forefront of China, but the level of volatility is relatively low, and the volatility of industrial development is relatively large. For Jiangsu, more attention should be paid to cultivating the sustainability of the development of the NEV industry to ensure that the NEV industry in Jiangsu can still maintain strong vitality and competitiveness in the future. Jiangsu should integrate the advantageous resources related to the NEV industry in the province, create a NEV industry development model, establish a regional development policy with Jiangsu characteristics, and ensure that the province's NEV industry leads the country. In addition, Jiangsu should focus on domestic and foreign market development, improve brand competitiveness, and strive to form international competitiveness.
5.3. Cluster analysis of NEV industry
This study uses dimensionless data to calculate the similarity distance between any two provinces under the attributes of absolute level, incremental level, and volatility level, and then calculate the index of each province and city under the spatiotemporal feature attribute with Eq (4.1). The grey relational analysis is used to calculate the correlation between any two provinces (Table 12). Finally, with three decisions to determine the threshold, a cluster analysis of the competitiveness of the NEV industry in each province is carried out.
Table 12.
The grey relational degree of the competitiveness of NEVs in each province.
Taking into account the government's emphasis on the development of high-tech industries and the risk of correct decision-making during evaluation, the loss function of the manager's decision-making status and action plan for the development of provincial high-tech industries is obtained (Table 13).
The class set can be further divided into three categories, the first category: Jiangsu, Shanghai and Beijing; the second: Zhejiang; third: Hubei, Hunan, Hebei, Henan, Anhui, Fujian, Sichuan, Shandong and Guangdong. Therefore, the competitiveness of the NEV industry in Jiangsu is closer to that of Shanghai and Beijing.
6.
Conclusions
This study measures the competitiveness of NEV industry of 13 provinces in China. This study shows that: 1) Under the absolute level of temporal and spatial characteristic attributes, the development of Jiangsu's NEV industry is in a leading position in China, and its competitiveness level is closer to that of Shanghai and Beijing; 2) Under the incremental level, Jiangsu ranks in the upper and middle reaches of 13 provinces, second only to Shanghai; 3) Under the volatility level, Jiangsu's industrial development fluctuates greatly, and the volatility level is in the middle reaches. There is a big gap with Shanghai; 4) From the perspective of overall temporal and spatial characteristics, Jiangsu's overall industrial development level is in the first echelon in China, second only to Shanghai and Beijing, indicating that Jiangsu's overall development level of NEV industry is relatively high. According to the clustering results, the competitiveness of the NEV industry in Jiangsu is closer to that of Shanghai and Beijing.
Based on the development plan of Jiangsu's new energy vehicle industry, and considering the gap between Jiangsu and the benchmark cities in calculating the main indicators, this paper proposes the following management enlightenment: 1) Improve the construction of charging infrastructure (scientific layout of charging facilities and power exchange facilities, improve the service level of charging facilities, and encourage business model innovation). 2) Increase the promotion of new energy vehicles, such as the government and the public sector playing a leading role in promoting new energy vehicle consumption. 3) Improve the technological innovation capability, such as the government increasing R & D investment, and automobile enterprises cooperating with key scientific research institutions and scientific research centers. 4) Improve the supporting parts industry, such as cross-regional cooperation and the introduction of leading enterprises. 5) Industrial support policies were introduced, such as increasing technical subsidies, and increasing subsidies and incentives for R & D enterprises on public relations and technical issues. 6) Jiangsu should integrate the relevant advantageous resources of the new energy vehicle industry, create a new energy vehicle industry development model, formulate regional development policies with local characteristics, pay attention to domestic and foreign market development, build brand competitiveness, and strive to form international competitiveness.
Acknowledgments
This study was funded by the National Natural Science Foundation of China 72101100, and the Philosophy and Social Science Projects in Universities of Jiangsu Province (2020SJA0861).
Conflict of interests
The authors declare no conflict of interest.
References
[1]
T. W. Kim, A. E. Azzaoui, B. Koh, J. Kim, J. H. Park, A secret sharing-based distributed cloud system for privacy protection, Hum. Centric Comput. Inf. Sci., 12 (2022). https://doi.org/10.22967/HCIS.2022.12.020 doi: 10.22967/HCIS.2022.12.020
[2]
C. Blundo, C. De Maio, M. Parente, L. Siniscalchi, Targeted advertising that protects the privacy of social networks users, Hum. Centric Comput. Inf. Sci., 11 (2021), 18. https://doi.org/10.22967/HCIS.2021.11.018 doi: 10.22967/HCIS.2021.11.018
[3]
C. Jia, C. Jia, L. Kong, W. Lin, L. Qi, Privacy-aware retrieval of electronic medical records by fuzzy keyword search, Hum. Centric Comput. Inf. Sci., 12 (2022). https://doi.org/10.22967/HCIS.2022.12.041 doi: 10.22967/HCIS.2022.12.041
[4]
L. Orans, A. Hils, J. D'Hoinne, E. Ahlm, Gartner, Predicts 2017: Network and Gateway Security, 2016.
F. Veysset, O. Courtay, O. Heen, New tool and technique for remote operating system fingerprinting, Intranode Softw. Technol., 4 (2002).
[8]
L. Bernaille, R. Teixeira, I. Akodkenou, A. Soule, K. Salamatian, Traffic classification on the fly, in: ACM Sigcomm Comput. Commun. Rev., 36 (2006), 23–26. https://doi.org/10.1145/1129582.1129589
[9]
P. Velan, M. Čermák, P. Čeleda, M. Drašar, A survey of methods for encrypted traffic classification and analysis, Int. J. Netw. Manag., 25 (2015), 355–374. https://doi.org/10.1002/nem.1901 doi: 10.1002/nem.1901
[10]
F. Pacheco, E. Exposito, M. Gineste, C. Baudoin, J. Aguilar, Towards the deployment of machine learning solutions in network traffic classification: A systematic survey, IEEE Commun. Surv. Tutor., 23 (2018), 1988–2014. https://doi.org/10.1109/COMST.2018.2883147 doi: 10.1109/COMST.2018.2883147
[11]
C. Oh, J. Ha, H. Roh, A survey on TLS-encrypted malware network traffic analysis applicable to security operations centers, Appl. Sci., 12 (2021), 155. https://doi.org/10.3390/app12010155 doi: 10.3390/app12010155
[12]
E. Papadogiannaki, S. Ioannidis, A survey on encrypted network traffic analysis applications, techniques, and countermeasures, ACM Comput. Surv., 54 (2021), 1–35. https://doi.org/10.1145/3457904 doi: 10.1145/3457904
[13]
H. Gao, W. Huang, T. Liu, Y. Yin, Y. Li, PPO2: Location privacy-oriented task offloading to edge computing using reinforcement learning for intelligent autonomous transport systems, IEEE Trans. Intell. Transport. Syst., (2022), 1–14. https://doi.org/10.1109/TITS.2022.3169421 doi: 10.1109/TITS.2022.3169421
[14]
Z. Zhang, Y. Li, H. Dong, H. Gao, Y. Jin, W. Wang, Spectral-based directed graph network for malware detection, spectral-based directed graph network for malware detection, IEEE Trans. Netw. Sci. Eng., 8 (2021), 957–970. https://doi.org/10.1109/TNSE.2020.3024557 doi: 10.1109/TNSE.2020.3024557
[15]
H. Gao, B. Qiu, R. J. Duran Barroso, W. Hussain, Y. Xu, X. Wang, TSMAE: A novel anomaly detection approach for Internet of things time series data using memory-augmented autoencoder, IEEE Trans. Netw. Sci. Eng., (2022), 1–1. https://doi.org/10.1109/TNSE.2022.3163144 doi: 10.1109/TNSE.2022.3163144
[16]
P. Li, X. Wang, H. Gao, X. Xu, M. Iqbal, K. Dahal, A dynamic and scalable user-centric route planning algorithm based on polychromatic sets theory, IEEE Trans. Intell. Transp. Syst., 23 (2022), 2762–2772. https://doi.org/10.1109/TITS.2021.3085026 doi: 10.1109/TITS.2021.3085026
[17]
A. Freier, P. Karlton, P. Kocher, The secure sockets layer (SSL) protocol version 3.0, The Internet Engineering Task Force, IETF. https://www.rfc-editor.org/rfc/rfc6101.html
R. L. Rivest, A. Shamir, L. Adleman, A method for obtaining digital signatures and public-key cryptosystems, Commun. ACM., 21 (1978), 120–126. https://doi.org/10.1145/359340.359342 doi: 10.1145/359340.359342
[20]
D. Johnson, A. Menezes, S. Vanstone, The elliptic curve digital signature algorithm (ECDSA), Int. J. Inf. Sec., 1 (2001), 36–63. https://doi.org/10.1007/s102070100002 doi: 10.1007/s102070100002
[21]
S. Josefsson, I. Liusvaara, Edwards-curve digital signature algorithm (EdDSA), Internet Engineering Task Force, IETF, (2017), No. rfc8032.
[22]
J. Bradley, B. Campbell, T. Lodderstedt, N. Sakimura, OAuth 2.0 mutual-TLS client authentication and certificate-bound access tokens, Internet Engineering Task Force, IETF, (2020), Rep. rfc8705.
D. Bertsekas, J. N. Tsitsiklis, Introduction to probability, Athena Scientific, 2008.
[25]
S. R. Eddy, What is a hidden Markov model?, Nat. Biotechnol., 22 (2004), 1315–1316. https://doi.org/10.1038/nbt1004-1315 doi: 10.1038/nbt1004-1315
[26]
L. Gong, X. Gong, Y. Liang, B. Zhang, A. Y. Yang, Life prediction of hydraulic concrete based on grey residual markov model, J. Inf. Process. Syst., 18 (2022), 457–469. https://doi.org/10.3745/JIPS.04.0247 doi: 10.3745/JIPS.04.0247
[27]
S. Dick, Artificial intelligence, Harv. Data Sci. Rev., 1 (2019). https://doi.org/10.1162/99608f92.92fe150c doi: 10.1162/99608f92.92fe150c
[28]
H. Yoon, S. Jeong, Electric power demand prediction using deep learning model with temperature data, KIPS transactions on software and data engineering, 11 (2022), 307–314. https://doi.org/10.3745/KTSDE.2022.11.7.307 doi: 10.3745/KTSDE.2022.11.7.307
[29]
H. Wang, Z. Lei, X. Zhang, B. Zhou, J. Peng, Machine learning basics, Deep Learn, (2016), 98–164.
[30]
M. I. Jordan, T. M. Mitchell, Machine learning: Trends, perspectives, and prospects, Science, 349 (2015), 255–260. https://doi.org/10.1126/science.aaa8415 doi: 10.1126/science.aaa8415
B. Anderson, D. McGrew, TLS beyond the browser: Combining end host and network data to understand application behavior, in: Proceedings of the Internet Measurement Conference, (2019), 379–392. https://doi.org/10.1145/3355369.3355601
M. Korczyński, A. Duda, Markov chain fingerprinting to classify encrypted traffic, in: IEEE Conference on Computer Communications, IEEE Publications Infocom, IEEE Publications, (2014), 781–789. https://doi.org/10.1109/INFOCOM.2014.6848005
[40]
C. Liu, Z. Cao, G. Xiong, G. Gou, S. M. Yiu, L. He, MaMPF: Encrypted traffic classification based on multi-attribute markov probability fingerprints, in: 26th International Symposium on Quality of Service (IWQoS), IEEE Publications/ACM, IEEE Publications, (2018), 1–10. https://doi.org/10.1109/IWQoS.2018.8624124
[41]
C. Liu, G. Xiong, G. Gou, S. M. Yiu, Z. Li, Z. Tian, Classifying encrypted traffic using adaptive fingerprints with multi-level attributes, World Wide Web, 24 (2021), 2071–2097. https://doi.org/10.1007/s11280-021-00940-0 doi: 10.1007/s11280-021-00940-0
[42]
D. Chao, A fingerprint enhancement and second-order Markov chain based malicious encrypted traffic identification scheme, in: Proceedings of the 2020 6th International Conference on Computing and Artificial Intelligence, (2020), 328–333. https://doi.org/10.1145/3404555.3404590
[43]
Y. Zhao, Y. N. Yang, K. Wu, Y. Hao, H. Su, Q. Zhao, A classification and identification technology of TLS encrypted traffic applications, in: I.E.E.E. IV International (Ed.) Conference on Big Data and Artificial Intelligence (BDAI), IEEE Publications, (2021), 160–164. https://doi.org/10.1109/BDAI52447.2021.9515274
[44]
B. Garn, D. E. Simos, S. Zauner, R. Kuhn, R. Kacker, Browser fingerprinting using combinatorial sequence testing, in: Proceedings of the 6th Annual Symposium on Hot Topics in the Science of Security, (2019), 1–9. https://doi.org/10.1145/3314058.3314062
[45]
B. Garn, S. Zauner, D. E. Simos, M. Leithner, R. Kuhn, R. Kacker, A Two-Step TLS-Based Browser fingerprinting approach using combinatorial sequences, Comput. Secur. J., 114 (2022), 102575. https://doi.org/10.1016/j.cose.2021.102575 doi: 10.1016/j.cose.2021.102575
[46]
R. Dubin, A. Dvir, O. Pele, O. Hadar, I know what you saw last minute—Encrypted http adaptive video streaming title classification, IEEE Trans. Inf. Forensics Secur., 12 (2017), 3039–3049. https://doi.org/10.1109/TIFS.2017.2730819 doi: 10.1109/TIFS.2017.2730819
[47]
L. Yang, S. Fu, Y. Luo, J. Shi, Markov probability fingerprints: A method for identifying encrypted video traffic, in: 16th International Conference on Mobility, Sensing and Networking (MSN), IEEE Publications, (2020), 283–290. https://doi.org/10.1109/MSN50589.2020.00055
[48]
K. Al-Naami, S. Chandra, A. Mustafa, L. Khan, Z. Lin, K. Hamlen, et al., Adaptive encrypted traffic fingerprinting with bi-directional dependence, in: Proceedings of the 32nd Annual Conference on Computer Security Applications, (2016), 177–188. https://doi.org/10.1145/2991079.2991123
[49]
A. Kanda, M. Hashimoto, Identification of TLS communications using randomness testing, in: 2021 IEEE Publications 45th Annual Computers, software, and Applications Conference (COMPSAC), 1099–1106. https://doi.org/10.1109/COMPSAC51774.2021.00150
[50]
L. E. Bassham Ⅲ, A. L. Rukhin, J. Soto, J. R. Nechvatal, M. E. Smid, E. B. Barker, et al., A statistical test suite for random and pseudorandom number generators for cryptographic applications, National Institute of Standards & Technology, 800–822, 2010.
[51]
K. Böttinger, D. Schuster, C. Eckert, Detecting fingerprinted data in TLS traffic, in: Proceedings of the 10th ACM Symposium on Information, Comput. Commun. Security, (2015), 633–638. https://doi.org/10.1145/2714576.2714595
[52]
Z. Zhang, C. Kang, G. Xiong, Z. Li, Deep forest with LRRS feature for fine-grained website fingerprinting with encrypted SSL/TLS, in: Proceedings of the 28th ACM International Conference on Information and Knowledge Management, (2019), 851–860. https://doi.org/10.1145/3357384.3357993
[53]
J. Lu, G. Gou, M. Su, D. Song, C. Liu, C. Yang, et al., GAP-WF: Graph attention pooling network for fine-grained SSL/TLS Website fingerprinting, in: International Joint Conference on Neural Networks (IJCNN), IEEE, (2021), 1–8. https://doi.org/10.1109/IJCNN52387.2021.9533543
[54]
C. Richter, M. Finsterbusch, J. A. Müller, K. Hänßgen, Classification of TLS applications, in: Proceedings of the 9th International Conference on Internet Monitoring and Protection, ICIMP, (2014), 1–6.
[55]
B. Anderson, Classifying encrypted traffic with TLS-aware telemetry, in: CERT, FloCon2016, (2016).
[56]
B. Anderson, D. McGrew, Identifying encrypted malware traffic with contextual flow data, in: Proceedings of the 2016 ACM Workshop on Artificial Intelligence and Security, (2016), 35–46. https://doi.org/10.1145/2996758.2996768
[57]
B. Anderson, S. Paul, D. McGrew, Deciphering malware's use of TLS (without decryption), J. Comput. Virol. Hacking Tech., 14 (2018), 195–211. https://doi.org/10.1007/s11416-017-0306-6 doi: 10.1007/s11416-017-0306-6
This article has been cited by:
1.
Shuaijun Lin, Lidan Hou,
SDGs-oriented evaluation of the sustainability of rural human settlement environment in Zhejiang, China,
2023,
9,
24058440,
e13492,
10.1016/j.heliyon.2023.e13492
2.
Xiangling Meng,
RETRACTED ARTICLE: Network Attribute Analysis and Competitiveness Evaluation of Auto Parts Industry Cluster for e-Commerce Platform,
2023,
16,
1875-6883,
10.1007/s44196-023-00308-4
5 primary indicators of environmental competitiveness, innovation competitiveness, manufacturing competitiveness, parts competitiveness and market competitiveness and 19 other secondary indicators.
6 first-level indicators of government behavior, demand conditions, production factors, relevant support industries, competitors in the same industry and technology-based indicators and 14 other secondary indicators.
5 primary indicators of basic competitiveness, industrial support, display competitiveness, enterprise competitiveness and product competitiveness and 18 other secondary indicators.
4 primary indicators of environmental competitiveness, market competitiveness, production competitiveness and international competitiveness and 16 other secondary indicators.
Percentage of new energy vehicle sales, annual sales of private charging posts, national per capita disposable income, age share of population aged 25–44, number of school students per 100,000 population.
5 primary indicators of environmental competitiveness, innovation competitiveness, manufacturing competitiveness, parts competitiveness and market competitiveness and 19 other secondary indicators.
6 first-level indicators of government behavior, demand conditions, production factors, relevant support industries, competitors in the same industry and technology-based indicators and 14 other secondary indicators.
5 primary indicators of basic competitiveness, industrial support, display competitiveness, enterprise competitiveness and product competitiveness and 18 other secondary indicators.
4 primary indicators of environmental competitiveness, market competitiveness, production competitiveness and international competitiveness and 16 other secondary indicators.
Percentage of new energy vehicle sales, annual sales of private charging posts, national per capita disposable income, age share of population aged 25–44, number of school students per 100,000 population.