Research article Special Issues

Deep reinforcement learning with emergent communication for coalitional negotiation games

  • For tasks intractable for a single agent, agents must cooperate to accomplish complex goals. A good example is coalitional games, where a group of individuals forms coalitions to produce jointly and share surpluses. In such coalitional negotiation games, how to strategically negotiate to reach agreements on gain allocation is however a key challenge, when the agents are independent and selfish. This work therefore employs deep reinforcement learning (DRL) to build autonomous agent called DALSL that can deal with arbitrary coalitional games without human input. Furthermore, DALSL agent is equipped with the ability to exchange information between them through emergent communication. We have proved that the agent can successfully form a team, distribute the team's benefits fairly, and can effectively use the language channel to exchange specific information, thereby promoting the establishment of small coalition and shortening the negotiation process. The experimental results shows that the DALSL agent obtains higher payoff when negotiating with handcrafted agents and other RL-based agents; moreover, it outperforms other competitors with a larger margin when the language channel is allowed.

    Citation: Siqi Chen, Yang Yang, Ran Su. Deep reinforcement learning with emergent communication for coalitional negotiation games[J]. Mathematical Biosciences and Engineering, 2022, 19(5): 4592-4609. doi: 10.3934/mbe.2022212

    Related Papers:

    [1] Jiafan Zhang . On the distribution of primitive roots and Lehmer numbers. Electronic Research Archive, 2023, 31(11): 6913-6927. doi: 10.3934/era.2023350
    [2] Yang Gao, Qingzhong Ji . On the inverse stability of zn+c. Electronic Research Archive, 2025, 33(3): 1414-1428. doi: 10.3934/era.2025066
    [3] J. Bravo-Olivares, E. Fernández-Cara, E. Notte-Cuello, M.A. Rojas-Medar . Regularity criteria for 3D MHD flows in terms of spectral components. Electronic Research Archive, 2022, 30(9): 3238-3248. doi: 10.3934/era.2022164
    [4] Zhefeng Xu, Xiaoying Liu, Luyao Chen . Hybrid mean value involving some two-term exponential sums and fourth Gauss sums. Electronic Research Archive, 2025, 33(3): 1510-1522. doi: 10.3934/era.2025071
    [5] Jorge Garcia Villeda . A computable formula for the class number of the imaginary quadratic field Q(p), p=4n1. Electronic Research Archive, 2021, 29(6): 3853-3865. doi: 10.3934/era.2021065
    [6] Li Wang, Yuanyuan Meng . Generalized polynomial exponential sums and their fourth power mean. Electronic Research Archive, 2023, 31(7): 4313-4323. doi: 10.3934/era.2023220
    [7] Qingjie Chai, Hanyu Wei . The binomial sums for four types of polynomials involving floor and ceiling functions. Electronic Research Archive, 2025, 33(3): 1384-1397. doi: 10.3934/era.2025064
    [8] Hai-Liang Wu, Li-Yuan Wang . Permutations involving squares in finite fields. Electronic Research Archive, 2022, 30(6): 2109-2120. doi: 10.3934/era.2022106
    [9] Li Rui, Nilanjan Bag . Fourth power mean values of one kind special Kloosterman's sum. Electronic Research Archive, 2023, 31(10): 6445-6453. doi: 10.3934/era.2023326
    [10] Hongliang Chang, Yin Chen, Runxuan Zhang . A generalization on derivations of Lie algebras. Electronic Research Archive, 2021, 29(3): 2457-2473. doi: 10.3934/era.2020124
  • For tasks intractable for a single agent, agents must cooperate to accomplish complex goals. A good example is coalitional games, where a group of individuals forms coalitions to produce jointly and share surpluses. In such coalitional negotiation games, how to strategically negotiate to reach agreements on gain allocation is however a key challenge, when the agents are independent and selfish. This work therefore employs deep reinforcement learning (DRL) to build autonomous agent called DALSL that can deal with arbitrary coalitional games without human input. Furthermore, DALSL agent is equipped with the ability to exchange information between them through emergent communication. We have proved that the agent can successfully form a team, distribute the team's benefits fairly, and can effectively use the language channel to exchange specific information, thereby promoting the establishment of small coalition and shortening the negotiation process. The experimental results shows that the DALSL agent obtains higher payoff when negotiating with handcrafted agents and other RL-based agents; moreover, it outperforms other competitors with a larger margin when the language channel is allowed.



    Let Fq be the finite field of q elements with characteristic p, where q=pr, p is a prime number. Let Fq=Fq{0} and Z+ denote the set of positive integers. Let sZ+ and bFq. Let f(x1,,xs) be a diagonal polynomial over Fq of the following form

    f(x1,,xs)=a1xm11+a2xm22++asxmss,

    where aiFq, miZ+, i=1,,s. Denote by Nq(f=b) the number of Fq-rational points on the affine hypersurface f=b, namely,

    Nq(f=b)=#{(x1,,xs)As(Fq)f(x1,,xs)=b}.

    In 1949, Hua and Vandiver [1] and Weil [2] independently obtained the formula of Nq(f=b) in terms of character sum as follows

    Nq(f=b)=qs1+ψ1(a11)ψs(ass)J0q(ψ1,,ψs), (1.1)

    where the sum is taken over all s multiplicative characters of Fq that satisfy ψmii=ε, ψiε, i=1,,s and ψ1ψs=ε. Here ε is the trivial multiplicative character of Fq, and J0q(ψ1,,ψs) is the Jacobi sum over Fq defined by

    J0q(ψ1,,ψs)=c1++cs=0,ciFqψ1(c1)ψs(cs).

    Though the explicit formula for Nq(f=b) are difficult to obtain in general, it has been studied extensively because of their theoretical importance as well as their applications in cryptology and coding theory; see[3,4,5,6,7,8,9]. In this paper, we use the Jacobi sums, Gauss sums and the results of quadratic form to deduce the formula of the number of Fq2-rational points on a class of hypersurfaces over Fq2 under certain conditions. The main result of this paper can be stated as

    Theorem 1.1. Let q=2r with rZ+ and Fq2 be the finite field of q2 elements. Let f(X)=a1xm11+a2xm22++asxmss, g(Y)=y1y2+y3y4++yn1yn+y2n2t1+ +y2n3+y2n1+bty2n2t++b1y2n2+b0y2n, and l(X,Y)=f(X)+g(Y), where ai,bjFq2, mi1, (mi,mk)=1, ik, mi|(q+1), miZ+, 2|n, n>2, 0tn22, TrFq2/F2(bj)=1 for i,k=1,,s and j=0,1,,t. For hFq2, we have

    (1) If h=0, then

    Nq2(l(X,Y)=0)=q2(s+n1)+γFq2(si=1((γai)mimi1)(qs+2n3+(1)tqs+n3)).

    (2) If hFq2, then

    Nq2(l(X,Y)=h)=q2(s+n1)+(qs+2n3+(1)t+1(q21)qs+n3)si=1((hai)mimi1)+γFq2{h}[si=1((γai)mimi1)(q2n+s3+(1)tqn+s3)].

    Here,

    (γai)mi={1,ifγaiisaresidueofordermi,0,otherwise.

    To prove Theorem 1.1, we need the lemmas and theorems below which are related to the Jacobi sums and Gauss sums.

    Definition 2.1. Let χ be an additive character and ψ a multiplicative character of Fq. The Gauss sum Gq(ψ,χ) in Fq is defined by

    Gq(ψ,χ)=xFqψ(x)χ(x).

    In particular, if χ is the canonical additive character, i.e., χ(x)=e2πiTrFq/Fp(x)/p where TrFq/Fp(y)=y+yp++ypr1 is the absolute trace of y from Fq to Fp, we simply write Gq(ψ):=Gq(ψ,χ).

    Let ψ be a multiplicative character of Fq which is defined for all nonzero elements of Fq. We extend the definition of ψ by setting ψ(0)=0 if ψε and ε(0)=1.

    Definition 2.2. Let ψ1,,ψs be s multiplicative characters of Fq. Then, Jq(ψ1,,ψs) is the Jacobi sum over Fq defined by

    Jq(ψ1,,ψs)=c1++cs=1,ciFqψ1(c1)ψs(cs).

    The Jacobi sums Jq(ψ1,,ψs) as well as the sums J0q(ψ1,,ψs) can be evaluated easily in case some of the multiplicative characters ψi are trivial.

    Lemma 2.3. ([10,Theorem 5.19,p. 206]) If the multiplicative characters ψ1,,ψs of Fq are trivial, then

    Jq(ψ1,,ψs)=J0q(ψ1,,ψs)=qs1.

    If some, but not all, of the ψi are trivial, then

    Jq(ψ1,,ψs)=J0q(ψ1,,ψs)=0.

    Lemma 2.4. ([10,Theorem 5.20,p. 206]) If ψ1,,ψs are multiplicative characters of Fq with ψs nontrivial, then

    J0q(ψ1,,ψs)=0

    if ψ1ψs is nontrivial and

    J0q(ψ1,,ψs)=ψs(1)(q1)Jq(ψ1,,ψs1)

    if ψ1ψs is trivial.

    If all ψi are nontrivial, there exists an important connection between Jacobi sums and Gauss sums.

    Lemma 2.5. ([10,Theorem 5.21,p. 207]) If ψ1,,ψs are nontrivial multiplicative characters of Fq and χ is a nontrivial additive character of Fq, then

    Jq(ψ1,,ψs)=Gq(ψ1,χ)Gq(ψs,χ)Gq(ψ1ψs,χ)

    if ψ1ψs is nontrivial and

    Jq(ψ1,,ψs)=ψs(1)Jq(ψ1,,ψs1)=1qGq(ψ1,χ)Gq(ψs,χ)

    if ψ1ψs is trivial.

    We turn to another special formula for Gauss sums which applies to a wider range of multiplicative characters but needs a restriction on the underlying field.

    Lemma 2.6. ([10,Theorem 5.16,p. 202]) Let q be a prime power, let ψ be a nontrivial multiplicative character of Fq2 of order m dividing q+1. Then

    Gq2(ψ)={q,ifmoddorq+1meven,q,ifmevenandq+1modd.

    For hFq2, define v(h)=1 if hFq2 and v(0)=q21. The property of the function v(h) will be used in the later proofs.

    Lemma 2.7. ([10,Lemma 6.23,p. 281]) For any finite field Fq, we have

    cFqv(c)=0,

    for any bFq,

    c1++cm=bv(c1)v(ck)={0,1k<m,v(b)qm1,k=m,

    where the sum is over all c1,,cmFq with c1++cm=b.

    The quadratic forms have been studied intensively. A quadratic form f in n indeterminates is called nondegenerate if f is not equivalent to a quadratic form in fewer than n indeterminates. For any finite field Fq, two quadratic forms f and g over Fq are called equivalent if f can be transformed into g by means of a nonsingular linear substitution of indeterminates.

    Lemma 2.8. ([10,Theorem 6.30,p. 287]) Let fFq[x1,,xn], q even, be a nondegenerate quadratic form. If n is even, then f is either equivalent to

    x1x2+x3x4++xn1xn

    or to a quadratic form of the type

    x1x2+x3x4++xn1xn+x2n1+ax2n,

    where aFq satisfies TrFq/Fp(a)=1.

    Lemma 2.9. ([10,Corollary 3.79,p. 127]) Let aFq and let p be the characteristic of Fq, the trinomial xpxa is irreducible in Fq if and only if TrFq/Fp(a)0.

    Lemma 2.10. ([10,Lemma 6.31,p. 288]) For even q, let aFq with TrFq/Fp(a)=1 and bFq. Then

    Nq(x21+x1x2+ax22=b)=qv(b).

    Lemma 2.11. ([10,Theorem 6.32,p. 288]) Let Fq be a finite field with q even and let bFq. Then for even n, the number of solutions of the equation

    x1x2+x3x4++xn1xn=b

    in Fnq is qn1+v(b)q(n2)/2. For even n and aFq with TrFq/Fp(a)=1, the number of solutions of the equation

    x1x2+x3x4++xn1xn+x2n1+ax2n=b

    in Fnq is qn1v(b)q(n2)/2.

    Lemma 2.12. Let q=2r and hFq2. Let g(Y)Fq2[y1,y2,,yn] be a polynomial of the form

    g(Y)=y1y2+y3y4++yn1yn+y2n2t1++y2n3+y2n1+bty2n2t++b1y2n2+b0y2n,

    where bjFq2, 2|n, n>2, 0tn22, TrFq2/F2(bj)=1, j=0,1,,t. Then

    Nq2(g(Y)=h)=q2(n1)+(1)t+1qn2v(h). (2.1)

    Proof. We provide two proofs here. The first proof is as follows. Let q1=q2. Then by Lemmas 2.7 and 2.10, the number of solutions of g(Y)=h in Fq2 can be deduced as

    Nq2(g(Y)=h)=c1+c2++ct+2=hNq2(y1y2+y3y4++yn2t3yn2t2=c1)Nq2(yn2t1yn2t+y2n2t1+bty2n2t=c2)Nq2(yn1yn+y2n1+b0y2n=ct+2)=c1+c2++ct+2=h(qn2t31+v(c1)q(n2t4)/21)(q1v(c2))(q1v(ct+2))=c1+c2++ct+2=h(qn2t21+v(c1)q(n2t2)/21v(c2)qn2t31v(c1)v(c2)q(n2t4)/21)(q1v(c3))(q1v(ct+2))=c1+c2++ct+2=h(qnt21+v(c1)q(n2)/21v(c2)qnt31++(1)t+1v(c1)v(c2)v(ct+2)q(n2t4)/21)=qn11+q(n2)/21c1Fq2v(c1)++(1)t+1c1+c2++ct+2=hv(c1)v(c2)v(ct+2)q(n2t4)/21. (2.2)

    By Lamma 2.7 and (2.2), we have

    Nq2(g(Y)=h)=qn11+(1)t+1v(h)q(n2)/21=q2(n1)+(1)t+1v(h)qn2.

    Next we give the second proof. Note that if f and g are equivalent, then for any bFq2 the equation f(x1,,xn)=b and g(x1,,xn)=b have the same number of solutions in Fq2. So we can get the number of solutions of g(Y)=h for hFq2 by means of a nonsingular linear substitution of indeterminates.

    Let k(X)Fq2[x1,x2,x3,x4] and k(X)=x1x2+x21+Ax22+x3x4+x23+Bx24, where TrFq2/F2(A)=TrFq2/F2(B)=1. We first show that k(x) is equivalent to x1x2+x3x4.

    Let x3=y1+y3 and xi=yi for i3, then k(X) is equivalent to y1y2+y1y4+y3y4+Ay22+y23+By24.

    Let y2=z2+z4 and yi=zi for i2, then k(X) is equivalent to z1z2+z3z4+Az22+z23+Az24+Bz24.

    Let z1=α1+Aα2 and zi=αi for i1, then k(X) is equivalent to α1α2+α23+α3α4+(A+B)α24.

    Since TrFq2/F2(A+B)=0, we have α23+α3α4+(A+B)α24 is reducible by Lemma 2.9. Then k(X) is equivalent to x1x2+x3x4. It follows that if t is odd, then g(Y) is equivalent to x1x2+x3x4++xn1xn, and if t is even, then g(Y) is equivalent to x1x2+x3x4++xn1xn+x2n1+ax2n with TrFq2/F2(a)=1. By Lemma 2.11, we get the desired result.

    From (1.1), we know that the formula for the number of solutions of f(X)=0 over Fq2 is

    Nq2(f(X)=0)=q2(s1)+d11j1=1ds1js=1¯ψj11(a1)¯ψjss(as)J0q2(ψj11,,ψjss),

    where di=(mi,q21) and ψi is a multiplicative character of Fq2 of order di. Since mi|q+1, we have di=mi. Let H={(j1,,js)1ji<mi, 1is}. It follows that ψj11ψjss is nontrivial for any (j1,,js)H as (mi,mj)=1. By Lemma 2, we have J0q2(ψj11,,ψjss)=0 and hence Nq2(f(X)=0)=q2(s1).

    Let Nq2(f(X)=c) denote the number of solutions of the equation f(X)=c over Fq2 with cFq2. Let V={(j1,,js)|0ji<mi,1is}. Then

    Nq2(f(X)=c)=γ1++γs=cNq2(a1xm11=γ1)Nq2(asxmss=γs)=γ1++γs=cm11j1=0ψj11(γ1a1)ms1js=0ψjss(γsas).

    Since ψi is a multiplicative character of Fq2 of order mi, we have

    Nq2(f(X)=c)=γ1c++γsc=1(j1,,js)Vψj11(γ1c)ψj11(ca1)ψjss(γsc)ψjss(cas)=(j1,,js)Vψj11(ca1)ψjss(cas)γ1c++γsc=1ψj11(γ1c)ψjss(γsc)=(j1,,js)Vψj11(ca1)ψjss(cas)Jq2(ψj11,,ψjss).

    By Lemma 2.3,

    Nq2(f(X)=c)=q2(s1)+(j1,,js)Hψj11(ca1)ψjss(cas)Jq2(ψj11,,ψjss).

    By Lemma 2.5,

    Jq2(ψj11,,ψjss)=Gq2(ψj11)Gq2(ψjss)Gq2(ψj11ψjss).

    Since mi|q+1 and 2mi, by Lemma 2.6, we have

    Gq2(ψj11)==Gq2(ψjss)=Gq2(ψj11ψjss)=q.

    Then

    Nq2(f(X)=c)=q2(s1)+qs1m11j1=1ψj11(ca1)ms1js=1ψjss(cas)=q2(s1)+qs1(m11j1=0ψj11(ca1)1)(ms1js=0ψjss(cas)1).

    It follows that

    Nq2(f(X)=c)=q2(s1)+qs1si=1((cai)mimi1), (3.1)

    where

    (cai)mi={1,ifcai is a residue of ordermi,0,otherwise.

    For a given hFq2. We discuss the two cases according to whether h is zero or not.

    Case 1: h=0. If f(X)=0, then g(Y)=0; if f(X)0, then g(Y)0. Then

    Nq2(l(X,Y)=0)=c1+c2=0Nq2(f(X)=c1)Nq2(g(Y)=c2)=q2(s1)(q2(n1)+(1)t+1(q21)qn2)+c1+c2=0c1,c2Fq2Nq2(f(X)=c1)Nq2(g(Y)=c2). (3.2)

    By Lemma 2.12, (3.1) and (3.2), we have

    Nq2(l(X,Y)=0)=q2(s+n2)+(1)t+1q2(s1)+hn(1)t+1q2(s2)+n+c1Fq2[q2(s+n2)(1)t+1q2(s2)+n+si=1((c1ai)mimi1)(q2n+s3(1)t+1qn+s3)]=q2(s+n2)+(1)t+1q2(s1)+n(1)t+1q2(s2)+n+q2(s+n1)(1)t+1q2(s1)+nq2(s+n2)+(1)t+1q2(s2)+n+c1Fq2[si=1((c1ai)mimi1)(q2n+s3(1)t+1qn+s3)]=q2(s+n1)+c1Fq2[si=1((c1ai)mimi1)(q2n+s3(1)t+1qn+s3)]. (3.3)

    Case 2: hFq2. If f(X)=h, then g(Y)=0; if f(X)=0, then g(Y)=h; if f(X){0,h}, then g(Y){0,h}. So we have

    Nq2(l(X,Y))=h)=c1+c2=hNq2(f(X)=c1)Nq2(g(Y)=c2)=Nq2(f(X)=0)Nq2(g(Y)=h)+Nq2(f(X)=h)Nq2(g(Y)=0)+c1+c2=hc1,c2Fq2{h}Nq2(f(X)=c1)Nq2(g(Y)=c2). (3.4)

    By Lemma 2.12, (3.1) and (3.4),

    Nq2(l(X,Y)=h)=2q2(s+n2)+(1)t+1q2s+n2(1)t+12q2s+n4+(qs+2n3+(1)t+1(q21)qs+n3)si=1((hai)mimi1)+c1Fq2{h}[q2(s+n2)(1)t+1q2s+n4+si=1((c1ai)mimi1)(q2n+s3(1)t+1qn+s3)].

    It follows that

    Nq2(l(X,Y)=h)=2q2(s+n2)+(1)t+1q2s+n2(1)t+12q2s+n4+(qs+2n3+(1)t+1(q21)qs+n3)si=1((hai)mimi1)+c1Fq2{h}[q2(s+n2)(1)t+1q2s+n4+si=1((c1ai)mimi1)(q2n+s3(1)t+1qn+s3)]=q2(s+n1)+(qs+2n3+(1)t+1(q21)qs+n3)si=1((hai)mimi1)+c1Fq2{h}[si=1((c1ai)mimi1)(q2n+s3+(1)tqn+s3)]. (3.5)

    By (3.3) and (3.5), we get the desired result. The proof of Theorem 1.1 is complete.

    There is a direct corollary of Theorem 1.1 and we omit its proof.

    Corollary 4.1. Under the conditions of Theorem 1.1, if a1==as=hFq2, then we have

    Nq2(l(X,Y)=h)=q2(s+n1)+(qs+2n3+(1)t+1(q21)qs+n3)si=1(mi1)+γFq2{h}[si=1((γh)mimi1)(q2n+s3+(1)tqn+s3)],

    where

    (γh)mi={1,ifγhisaresidueofordermi,0,otherwise.

    Finally, we give two examples to conclude the paper.

    Example 4.2. Let F210=α=F2[x]/(x10+x3+1) where α is a root of x10+x3+1. Suppose l(X,Y)=α33x31+x112+y23+α10y24+y1y2+y3y4. Clearly, TrF210/F2(α10)=1, m1=3, m2=11, s=2, n=4, t=0, a2=1. By Theorem 1.1, we have

    N210(l(X,Y)=0)=10245+(327+323)×20=1126587102265344.

    Example 4.3. Let F212=β=F2[x]/(x12+x6+x4+x+1) where β is a root of x12+x6+x4+x+1. Suppose l(X,Y)=x51+x132+y23+β10y24+y1y2+y3y4. Clearly, TrF212/F2(β10)=1, m1=5, m2=13, s=2, n=4, t=0, a1=a2=1. By Corollary 1, we have

    N212(l(X,Y)=1)=25×12+(647643×4095)×48=1153132559312355328.

    This work was jointly supported by the Natural Science Foundation of Fujian Province, China under Grant No. 2022J02046, Fujian Key Laboratory of Granular Computing and Applications (Minnan Normal University), Institute of Meteorological Big Data-Digital Fujian and Fujian Key Laboratory of Data Science and Statistics.

    The authors declare there is no conflicts of interest.



    [1] D. Silver, A. Huang, C. J. Maddison, A. Guez, L. Sifre, G. Van Den Driessche, et al., Mastering the game of go with deep neural networks and tree search, Nature, 529 (2016), 484–489. https://doi.org/10.1038/nature16961 doi: 10.1038/nature16961
    [2] M. Moravcík, M. Schmid, N. Burch, V. Lisý, D. Morrill, N. Bard, et al., Deepstack: Expert-level artificial intelligence in no-limit poker, CoRR, abs/1701.01724.
    [3] M. V. Devarakonda, C. Tsou, Automated problem list generation from electronic medical records in IBM watson, in Proc. Twenty-Ninth AAAI Conf. Artif. Intell., (eds. B. Bonet, S. Koenig), (2015), 3942–3947.
    [4] D. Leech, Designing the voting system for the council of the european union, Public Choice, 113 (2002), 473–464. https://doi.org/10.1023/A:1020877015060 doi: 10.1023/A:1020877015060
    [5] O. Shehory, S. Kraus, Methods for task allocation via agent coalition formation, Artif. Intell., 101 (1998), 165–200. https://doi.org/10.1016/S0004-3702(98)00045-9 doi: 10.1016/S0004-3702(98)00045-9
    [6] Y. Zick, K. Gal, Y. Bachrach, M. Mash, How to form winning coalitions in mixed human-computer settings, in Proc. Twenty-Sixth Int. Joint Conf. Artif. Intell., IJCAI (ed. C. Sierra), (2017), 465–471. https://doi.org/10.24963/ijcai.2017/66
    [7] L. S. Shapley, M. Shubik, A method for evaluating the distribution of power in a committee system, Am. political Sci. Rev., 48 (1954), 787–792. https://doi.org/10.2307/1951053 doi: 10.2307/1951053
    [8] J. F. Banzhaf III, Weighted voting doesn't work: A mathematical analysis, Rutgers L. Rev., 19 (1964), 317.
    [9] L. Wu, S. Chen, X. Gao, Y. Zheng, J. Hao, Detecting and learning against unknown opponents for automated negotiations, in PRICAI 2021: Trends in Artificial Intelligence (eds. D. N. Pham, T. Theeramunkong, G. Governatori and F. Liu), (2021), 17–31. https://doi.org/10.1007/978-3-030-89370-5_2
    [10] X. Gao, S. Chen, Y. Zheng, J. Hao, A deep reinforcement learning-based agent for negotiation with multiple communication channels, in 2021 IEEE 33nd Int. Conf. Tools with Artif. Intell. (ICTAI), (2021), 868–872. https://doi.org/10.1109/ICTAI52525.2021.00139
    [11] C. Gao, J. Liu, Network-based modeling for characterizing human collective behaviors during extreme events, IEEE Trans. Syst. Man Cybern. Syst., 47 (2017), 171–183. https://doi.org/10.1109/TSMC.2016.2608658
    [12] H. Mao, Z. Zhang, Z. Xiao, Z. Gong, Y. Ni, Learning multi-agent communication with double attentional deep reinforcement learning, Auton. Agents Multi Agent Syst., 34 (2020), 32. https://doi.org/10.1007/s10458-020-09455-w doi: 10.1007/s10458-020-09455-w
    [13] J. N. Foerster, Y. M. Assael, N. De Freitas, S. Whiteson, Learning to communicate with deep multi-agent reinforcement learning, arXiv prints, arXiv: 1605.06676.
    [14] P. Peng, Y. Wen, Y. Yang, Q. Yuan, Z. Tang, H. Long, et al., Multiagent bidirectionally-coordinated nets: Emergence of human-level coordination in learning to play starcraft combat games, arXiv prints, arXiv: 1703.10069.
    [15] T. Eccles, Y. Bachrach, G. Lever, A. Lazaridou, T. Graepel, Biases for emergent communication in multi-agent reinforcement learning, in Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, Vancouver, BC, Canada (eds. H. M. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. B. Fox, R. Garnett), (2019), 13111–13121. https://dl.acm.org/doi/10.5555/3454287.3455463
    [16] E. Hughes, T. W. Anthony, T. Eccles, J. Z. Leibo, D. Balduzzi, Y. Bachrach, Learning to resolve alliance dilemmas in many-player zero-sum games, in Proceedings of the 19th International Conference on Autonomous Agents and Multiagent Systems, AAMAS '20, (eds. A. E. F. Seghrouchni, G. Sukthankar, B. An, N. Yorke{-}Smith), (2020), 538–547.
    [17] T. Matthews, S. Ramchurn, G. Chalkiadakis, Competing with humans at fantasy football: Team formation in large partially-observable domains, in Proc. AAAI Conf. Artif. Intell., 26 (2012). https://ojs.aaai.org/index.php/AAAI/article/view/8259
    [18] Y. Bachrach, R. Everett, E. Hughes, A. Lazaridou, J. Z. Leibo, M. Lanctot, et al., Negotiating team formation using deep reinforcement learning, Artif. Intell., 288 (2020), 103356. https://doi.org/10.1016/j.artint.2020.103356 doi: 10.1016/j.artint.2020.103356
    [19] J. W. Crandall, M. Oudah, F. Ishowo-Oloko, S. Abdallah, J. F. Bonnefon, M. Cebrian, et al., Cooperating with machines, Nat. Commun., 9 (2018), 1–12. https://doi.org/10.1038/s41467-017-02597-8
    [20] K. Cao, A. Lazaridou, M. Lanctot, J. Z. Leibo, K. Tuyls, S. Clark, Emergent communication through negotiation, in 6th Int. Conf. Learn. Represent., ICLR 2018, Vancouver, Conference Track Proceedings, 2018.
    [21] Y. Shoham, K. Leyton-Brown, Multiagent systems: Algorithmic, game-theoretic, and logical foundations, Cambridge University Press, 2008. https://dl.acm.org/doi/abs/10.1145/1753171.1753181
    [22] D. K. Kim, S. Omidshafiei, J. Pazis, J. P. How, Crossmodal attentive skill learner: learning in atari and beyond with audio–-video inputs, Auton. Agent. Multi Agent Syst., 34 (2020), 1–21. https://doi.org/10.1007/s10458-019-09439-5 doi: 10.1007/s10458-019-09439-5
    [23] R. Su, Y. Zhu, Q. Zou, L. Wei, Distant metastasis identification based on optimized graph representation of gene interaction patterns, Brief. Bioinform., 23, (2022), bbab468. http://doi.org/10.1093/bib/bbab468
    [24] J. Liu, R. Su, J. Zhang, L. Wei, Classification and gene selection of triple-negative breast cancer subtype embedding gene connectivity matrix in deep neural network, Brief. Bioinform., 22, (2021), bbaa395. https://doi.org/10.1093/bib/bbaa395
    [25] A. Rubinstein, Perfect equilibrium in a bargaining model, Econometrica, 50 (1982), 97–109.
    [26] S. Chen, G. Weiss, An intelligent agent for bilateral negotiation with unknown opponents in continuous-time domains, ACM Trans. Auton. Adapt. Syst., 9 (2014), 16: 1–16: 24. https://dl.acm.org/doi/10.1145/2629577
    [27] S. Chen, G. Weiss, An approach to complex agent-based negotiations via effectively modeling unknown opponents, Expert Syst. Appl., 42 (2015), 2287–2304. https://doi.org/10.1016/j.eswa.2014.10.048 doi: 10.1016/j.eswa.2014.10.048
    [28] K. Dautenhahn, Socially intelligent robots: dimensions of human–robot interaction, Philos. Trans. R. Soc. B Biol. Sci., 362 (2007), 679–704. https://doi.org/10.1098/rstb.2006.2004 doi: 10.1098/rstb.2006.2004
    [29] S. Chen, Y. Cui, C. Shang, J. Hao, G. Weiss, Onecg: Online negotiation environment for coalitional games, in Proc. 18th Int. Conf. Auton. Agent. MultiAg. Syst., (2019), 2348–2350. https://dl.acm.org/doi/10.5555/3306127.3332108
    [30] G. A. Rummery, M. Niranjan, On-line Q-learning using connectionist systems, University of Cambridge, Department of Engineering Cambridge, UK, 1994.
    [31] R. Su, X. Liu, L. Wei, Q. Zou, {Deep-Resp-Forest}: A deep forest model to predict anti-cancer drug response, Methods, 166 (2019) 91–102. https://doi.org/10.1016/j.ymeth.2019.02.009
    [32] R. Su, X. Liu, Q. Jin, X. Liu, L. Wei, Identification of glioblastoma molecular subtype and prognosis based on deep mri features, Knowl. Based Syst., 232 (2021), 107490. https://doi.org/10.1016/j.knosys.2021.107490 doi: 10.1016/j.knosys.2021.107490
    [33] R. Su, H. Wu, B. Xu, X. Liu, L. Wei, Developing a multi-dose computational model for drug-induced hepatotoxicity prediction based on toxicogenomics data, IEEE/ACM Trans. Comput. Biol. Bioinform., 16 (2018), 1231–1239. https://doi.org/10.1109/TCBB.2018.2858756 doi: 10.1109/TCBB.2018.2858756
  • Reader Comments
  • © 2022 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)
通讯作者: 陈斌, bchen63@163.com
  • 1. 

    沈阳化工大学材料科学与工程学院 沈阳 110142

  1. 本站搜索
  2. 百度学术搜索
  3. 万方数据库搜索
  4. CNKI搜索

Metrics

Article views(2517) PDF downloads(101) Cited by(8)

Figures and Tables

Figures(5)  /  Tables(1)

Other Articles By Authors

/

DownLoad:  Full-Size Img  PowerPoint
Return
Return

Catalog