Reinforcement Learning-Aided Channel Estimator in Time-Varying MIMO Systems.

Tae-Kyoung Kim, Moonsik Min
Author Information
  1. Tae-Kyoung Kim: Department of Electronic Engineering, Gachon University, Seongnam 13120, Republic of Korea. ORCID
  2. Moonsik Min: School of Electronic and Electrical Engineering, Kyungpook National University, Daegu 41566, Republic of Korea. ORCID

Abstract

This paper proposes a reinforcement learning-aided channel estimator for time-varying multi-input multi-output systems. The basic concept of the proposed channel estimator is the selection of the detected data symbol in the data-aided channel estimation. To achieve the selection successfully, we first formulate an optimization problem to minimize the data-aided channel estimation error. However, in time-varying channels, the optimal solution is difficult to derive because of its computational complexity and the time-varying nature of the channel. To address these difficulties, we consider a sequential selection for the detected symbols and a refinement for the selected symbols. A Markov decision process is formulated for sequential selection, and a reinforcement learning algorithm that efficiently computes the optimal policy is proposed with state element refinement. Simulation results demonstrate that the proposed channel estimator outperforms conventional channel estimators by efficiently capturing the variation of the channels.

Keywords

References

  1. Sensors (Basel). 2021 Jul 16;21(14): [PMID: 34300599]
  2. Sensors (Basel). 2021 Dec 31;22(1): [PMID: 35009848]
  3. Sensors (Basel). 2022 Jun 09;22(12): [PMID: 35746162]

Grants

  1. 2021R1F1A1063273/National Research Foundation of Korea
  2. 2023R1A2C1004034/National Research Foundation of Korea
  3. 4199990113966/Ministry of Education, Korea

MeSH Term

Algorithms
Computer Simulation
Markov Chains
Policy

Word Cloud

Created with Highcharts 10.0.0channelselectionreinforcementestimatortime-varyingproposeddata-aidedestimationdetectedchannelsoptimalsequentialsymbolsrefinementlearningefficientlypaperproposeslearning-aidedmulti-inputmulti-outputsystemsbasicconceptdatasymbolachievesuccessfullyfirstformulateoptimizationproblemminimizeerrorHoweversolutiondifficultderivecomputationalcomplexitynatureaddressdifficultiesconsiderselectedMarkovdecisionprocessformulatedalgorithmcomputespolicystateelementSimulationresultsdemonstrateoutperformsconventionalestimatorscapturingvariationReinforcementLearning-AidedChannelEstimatorTime-VaryingMIMOSystemsfirst-orderGaussian—Markovmodelnon-iterativeapproach

Similar Articles

Cited By