Losses resulting from deliberate exploration trigger beta oscillations in frontal cortex
We examined the neural signature of directed exploration by contrasting MEG beta (16–30 Hz) power changes between disadvantageous and advantageous choices in the two-choice probabilistic reward task. We analyzed the choices made after the participants have learned the probabilistic contingency betwe...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2023-05-01
|
| Series: | Frontiers in Neuroscience |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fnins.2023.1152926/full |
| _version_ | 1797829260847611904 |
|---|---|
| author | Boris V. Chernyshev Boris V. Chernyshev Boris V. Chernyshev Kristina I. Pultsina Vera D. Tretyakova Aleksandra S. Miasnikova Andrey O. Prokofyev Galina L. Kozunova Tatiana A. Stroganova |
| author_facet | Boris V. Chernyshev Boris V. Chernyshev Boris V. Chernyshev Kristina I. Pultsina Vera D. Tretyakova Aleksandra S. Miasnikova Andrey O. Prokofyev Galina L. Kozunova Tatiana A. Stroganova |
| author_sort | Boris V. Chernyshev |
| collection | DOAJ |
| description | We examined the neural signature of directed exploration by contrasting MEG beta (16–30 Hz) power changes between disadvantageous and advantageous choices in the two-choice probabilistic reward task. We analyzed the choices made after the participants have learned the probabilistic contingency between choices and their outcomes, i.e., acquired the inner model of choice values. Therefore, rare disadvantageous choices might serve explorative, environment-probing purposes. The study brought two main findings. Firstly, decision making leading to disadvantageous choices took more time and evidenced greater large-scale suppression of beta oscillations than its advantageous alternative. Additional neural resources recruited during disadvantageous decisions strongly suggest their deliberately explorative nature. Secondly, an outcome of disadvantageous and advantageous choices had qualitatively different impact on feedback-related beta oscillations. After the disadvantageous choices, only losses—but not gains—were followed by late beta synchronization in frontal cortex. Our results are consistent with the role of frontal beta oscillations in the stabilization of neural representations for selected behavioral rule when explorative strategy conflicts with value-based behavior. Punishment for explorative choice being congruent with its low value in the reward history is more likely to strengthen, through punishment-related beta oscillations, the representation of exploitative choices consistent with the inner utility model. |
| first_indexed | 2024-04-09T13:17:37Z |
| format | Article |
| id | doaj.art-2fec3ea262c54992b1570f89b9ebfdb6 |
| institution | Directory Open Access Journal |
| issn | 1662-453X |
| language | English |
| last_indexed | 2024-04-09T13:17:37Z |
| publishDate | 2023-05-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Neuroscience |
| spelling | doaj.art-2fec3ea262c54992b1570f89b9ebfdb62023-05-11T14:26:59ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2023-05-011710.3389/fnins.2023.11529261152926Losses resulting from deliberate exploration trigger beta oscillations in frontal cortexBoris V. Chernyshev0Boris V. Chernyshev1Boris V. Chernyshev2Kristina I. Pultsina3Vera D. Tretyakova4Aleksandra S. Miasnikova5Andrey O. Prokofyev6Galina L. Kozunova7Tatiana A. Stroganova8Center for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, RussiaDepartment of Higher Nervous Activity, Lomonosov Moscow State University, Moscow, RussiaDepartment of Psychology, Higher School of Economics, Moscow, RussiaCenter for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, RussiaCenter for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, RussiaCenter for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, RussiaCenter for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, RussiaCenter for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, RussiaCenter for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, RussiaWe examined the neural signature of directed exploration by contrasting MEG beta (16–30 Hz) power changes between disadvantageous and advantageous choices in the two-choice probabilistic reward task. We analyzed the choices made after the participants have learned the probabilistic contingency between choices and their outcomes, i.e., acquired the inner model of choice values. Therefore, rare disadvantageous choices might serve explorative, environment-probing purposes. The study brought two main findings. Firstly, decision making leading to disadvantageous choices took more time and evidenced greater large-scale suppression of beta oscillations than its advantageous alternative. Additional neural resources recruited during disadvantageous decisions strongly suggest their deliberately explorative nature. Secondly, an outcome of disadvantageous and advantageous choices had qualitatively different impact on feedback-related beta oscillations. After the disadvantageous choices, only losses—but not gains—were followed by late beta synchronization in frontal cortex. Our results are consistent with the role of frontal beta oscillations in the stabilization of neural representations for selected behavioral rule when explorative strategy conflicts with value-based behavior. Punishment for explorative choice being congruent with its low value in the reward history is more likely to strengthen, through punishment-related beta oscillations, the representation of exploitative choices consistent with the inner utility model.https://www.frontiersin.org/articles/10.3389/fnins.2023.1152926/fulldecision makingexplorationgamblingprobabilistic taskfrontal beta oscillationsmagnetoencephalography |
| spellingShingle | Boris V. Chernyshev Boris V. Chernyshev Boris V. Chernyshev Kristina I. Pultsina Vera D. Tretyakova Aleksandra S. Miasnikova Andrey O. Prokofyev Galina L. Kozunova Tatiana A. Stroganova Losses resulting from deliberate exploration trigger beta oscillations in frontal cortex Frontiers in Neuroscience decision making exploration gambling probabilistic task frontal beta oscillations magnetoencephalography |
| title | Losses resulting from deliberate exploration trigger beta oscillations in frontal cortex |
| title_full | Losses resulting from deliberate exploration trigger beta oscillations in frontal cortex |
| title_fullStr | Losses resulting from deliberate exploration trigger beta oscillations in frontal cortex |
| title_full_unstemmed | Losses resulting from deliberate exploration trigger beta oscillations in frontal cortex |
| title_short | Losses resulting from deliberate exploration trigger beta oscillations in frontal cortex |
| title_sort | losses resulting from deliberate exploration trigger beta oscillations in frontal cortex |
| topic | decision making exploration gambling probabilistic task frontal beta oscillations magnetoencephalography |
| url | https://www.frontiersin.org/articles/10.3389/fnins.2023.1152926/full |
| work_keys_str_mv | AT borisvchernyshev lossesresultingfromdeliberateexplorationtriggerbetaoscillationsinfrontalcortex AT borisvchernyshev lossesresultingfromdeliberateexplorationtriggerbetaoscillationsinfrontalcortex AT borisvchernyshev lossesresultingfromdeliberateexplorationtriggerbetaoscillationsinfrontalcortex AT kristinaipultsina lossesresultingfromdeliberateexplorationtriggerbetaoscillationsinfrontalcortex AT veradtretyakova lossesresultingfromdeliberateexplorationtriggerbetaoscillationsinfrontalcortex AT aleksandrasmiasnikova lossesresultingfromdeliberateexplorationtriggerbetaoscillationsinfrontalcortex AT andreyoprokofyev lossesresultingfromdeliberateexplorationtriggerbetaoscillationsinfrontalcortex AT galinalkozunova lossesresultingfromdeliberateexplorationtriggerbetaoscillationsinfrontalcortex AT tatianaastroganova lossesresultingfromdeliberateexplorationtriggerbetaoscillationsinfrontalcortex |