MetNet: A Novel Low-Complexity Neural Network-Aided Detection for Faster-Than-Nyquist (FTN) Signaling in ISI Channels

This paper studies the application of neural networks to Viterbi detection of FTN signals in an intersymbol interference (ISI) channel. The main contribution of this paper is to propose a receiver structure for detecting FTN signals in unknown static ISI channel. In particular, we propose a novel lo...

Full description

Bibliographic Details
Main Authors: Ammar Abdelsamie, Ian Marsland, Ahmed Ibrahim, Halim Yanikomeroglu
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Open Journal of the Communications Society
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10071549/
_version_ 1797342338542993408
author Ammar Abdelsamie
Ian Marsland
Ahmed Ibrahim
Halim Yanikomeroglu
author_facet Ammar Abdelsamie
Ian Marsland
Ahmed Ibrahim
Halim Yanikomeroglu
author_sort Ammar Abdelsamie
collection DOAJ
description This paper studies the application of neural networks to Viterbi detection of FTN signals in an intersymbol interference (ISI) channel. The main contribution of this paper is to propose a receiver structure for detecting FTN signals in unknown static ISI channel. In particular, we propose a novel low-complexity neural network structure for calculating the branch metrics, and we explore its suitability for FTN signalling with channel uncertainty. We compare the proposed network, which we call the Metric Net (MetNet), to a benchmark neural network-based technique for metric calculation, the ViterbiNet, which was originally designed for ISI channels. The simulation results confirm that the MetNet outperforms the ViterbiNet, with two orders of magnitude lower complexity, and is much more resilient to channel uncertainty than the traditional Viterbi detector, which uses Euclidean distance for metric calculations. We further show that the MetNet exhibits robustness to being trained at mismatched SNR values and FTN pulse acceleration factors, meaning that the number of trained models required can be significantly reduced. Additionally, the results show that the proposed MetNet remains a favorable alternative at much higher levels of channel uncertainties. The results also reflect that we can generalize the MetNet to work with different channel models defined by different decaying factors. Finally, we show that we succeed in achieving a bandwidth efficiency gain of 33% due to FTN by using the MetNet in the presence of channel uncertainty.
first_indexed 2024-03-08T10:31:51Z
format Article
id doaj.art-d0bf838950764a3ca4bca6c436ca4d33
institution Directory Open Access Journal
issn 2644-125X
language English
last_indexed 2024-03-08T10:31:51Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Open Journal of the Communications Society
spelling doaj.art-d0bf838950764a3ca4bca6c436ca4d332024-01-27T00:03:21ZengIEEEIEEE Open Journal of the Communications Society2644-125X2023-01-01479880910.1109/OJCOMS.2023.325378910071549MetNet: A Novel Low-Complexity Neural Network-Aided Detection for Faster-Than-Nyquist (FTN) Signaling in ISI ChannelsAmmar Abdelsamie0https://orcid.org/0000-0002-9811-0106Ian Marsland1https://orcid.org/0000-0002-8991-9093Ahmed Ibrahim2https://orcid.org/0000-0002-4823-4098Halim Yanikomeroglu3https://orcid.org/0000-0003-4776-9354Systems and Computer Engineering Department, Carleton University, Ottawa, CanadaSystems and Computer Engineering Department, Carleton University, Ottawa, CanadaSystems and Computer Engineering Department, Carleton University, Ottawa, CanadaSystems and Computer Engineering Department, Carleton University, Ottawa, CanadaThis paper studies the application of neural networks to Viterbi detection of FTN signals in an intersymbol interference (ISI) channel. The main contribution of this paper is to propose a receiver structure for detecting FTN signals in unknown static ISI channel. In particular, we propose a novel low-complexity neural network structure for calculating the branch metrics, and we explore its suitability for FTN signalling with channel uncertainty. We compare the proposed network, which we call the Metric Net (MetNet), to a benchmark neural network-based technique for metric calculation, the ViterbiNet, which was originally designed for ISI channels. The simulation results confirm that the MetNet outperforms the ViterbiNet, with two orders of magnitude lower complexity, and is much more resilient to channel uncertainty than the traditional Viterbi detector, which uses Euclidean distance for metric calculations. We further show that the MetNet exhibits robustness to being trained at mismatched SNR values and FTN pulse acceleration factors, meaning that the number of trained models required can be significantly reduced. Additionally, the results show that the proposed MetNet remains a favorable alternative at much higher levels of channel uncertainties. The results also reflect that we can generalize the MetNet to work with different channel models defined by different decaying factors. Finally, we show that we succeed in achieving a bandwidth efficiency gain of 33% due to FTN by using the MetNet in the presence of channel uncertainty.https://ieeexplore.ieee.org/document/10071549/Faster-than-Nyquistmaximum likelihood sequence estimationAI based signal detectionspectral efficiency enhancementintersymbol interference
spellingShingle Ammar Abdelsamie
Ian Marsland
Ahmed Ibrahim
Halim Yanikomeroglu
MetNet: A Novel Low-Complexity Neural Network-Aided Detection for Faster-Than-Nyquist (FTN) Signaling in ISI Channels
IEEE Open Journal of the Communications Society
Faster-than-Nyquist
maximum likelihood sequence estimation
AI based signal detection
spectral efficiency enhancement
intersymbol interference
title MetNet: A Novel Low-Complexity Neural Network-Aided Detection for Faster-Than-Nyquist (FTN) Signaling in ISI Channels
title_full MetNet: A Novel Low-Complexity Neural Network-Aided Detection for Faster-Than-Nyquist (FTN) Signaling in ISI Channels
title_fullStr MetNet: A Novel Low-Complexity Neural Network-Aided Detection for Faster-Than-Nyquist (FTN) Signaling in ISI Channels
title_full_unstemmed MetNet: A Novel Low-Complexity Neural Network-Aided Detection for Faster-Than-Nyquist (FTN) Signaling in ISI Channels
title_short MetNet: A Novel Low-Complexity Neural Network-Aided Detection for Faster-Than-Nyquist (FTN) Signaling in ISI Channels
title_sort metnet a novel low complexity neural network aided detection for faster than nyquist ftn signaling in isi channels
topic Faster-than-Nyquist
maximum likelihood sequence estimation
AI based signal detection
spectral efficiency enhancement
intersymbol interference
url https://ieeexplore.ieee.org/document/10071549/
work_keys_str_mv AT ammarabdelsamie metnetanovellowcomplexityneuralnetworkaideddetectionforfasterthannyquistftnsignalinginisichannels
AT ianmarsland metnetanovellowcomplexityneuralnetworkaideddetectionforfasterthannyquistftnsignalinginisichannels
AT ahmedibrahim metnetanovellowcomplexityneuralnetworkaideddetectionforfasterthannyquistftnsignalinginisichannels
AT halimyanikomeroglu metnetanovellowcomplexityneuralnetworkaideddetectionforfasterthannyquistftnsignalinginisichannels