论文标题
股票交易多代理增强学习的公平性
Fairness in Multi-agent Reinforcement Learning for Stock Trading
论文作者
论文摘要
不公平的股票交易策略已被证明是客户可能对交易产生的最负面看法之一,并可能导致公司长期损失。投资银行通常为具有相同目标资产的多个客户下达交易订单,但订单规模不同,诸如时间范围和风险规避水平等不同的要求,从而无法同时优化总收入和个人收入。较早执行的订单将影响市场价格水平,因此迟到的执行通常意味着额外的实施成本。在本文中,我们提出了一个新颖的计划,该计划利用多代理增强学习系统来为所有客户提供股票交易策略,以保持收入和公平之间保持平衡。首先,我们证明了强化学习(RL)能够从经验中学习并将交易策略调整到复杂的市场环境中。其次,我们表明多代理RL系统允许单独开发所有客户的交易策略,从而优化个人收入。第三,我们使用广义的Gini指数(GGI)聚合功能来控制所有客户收入的公平水平。最后,我们从经验上证明了新计划在改善公平性方面的优势,同时保持收入优化。
Unfair stock trading strategies have been shown to be one of the most negative perceptions that customers can have concerning trading and may result in long-term losses for a company. Investment banks usually place trading orders for multiple clients with the same target assets but different order sizes and diverse requirements such as time frame and risk aversion level, thereby total earning and individual earning cannot be optimized at the same time. Orders executed earlier would affect the market price level, so late execution usually means additional implementation cost. In this paper, we propose a novel scheme that utilizes multi-agent reinforcement learning systems to derive stock trading strategies for all clients which keep a balance between revenue and fairness. First, we demonstrate that Reinforcement learning (RL) is able to learn from experience and adapt the trading strategies to the complex market environment. Secondly, we show that the Multi-agent RL system allows developing trading strategies for all clients individually, thus optimizing individual revenue. Thirdly, we use the Generalized Gini Index (GGI) aggregation function to control the fairness level of the revenue across all clients. Lastly, we empirically demonstrate the superiority of the novel scheme in improving fairness meanwhile maintaining optimization of revenue.