Newton’s method for reinforcement learning and model predictive control by Dimitri Bertsekas

“…In these game contexts, the off-line training algorithm is the method used to teach the program how to evaluate positions and to generate good moves at any given position, while the on-line play algorithm is the method used to play in real time against human or computer opponents.Both AlphaZero and TD-Gammon were trained off-line extensively using neural networks and an approximate version of the fundamental DP algorithm of policy iteration. Yet the AlphaZero player that was obtained off-line is not used directly during on-line play (it is too inaccurate due to approximation errors that are inherent in off-line neural network training). …”
Get full text

Inter‐scanner Aβ‐PET harmonization using barrel phantom spatial resolution matching by Gihan P. Ruwanpathirana, Robert C. Williams, Colin L. Masters, Christopher C. Rowe, Leigh A. Johnston, Catherine E. Davey

“…The Vision and mCT scans were reconstructed using various iterations, subsets, and post‐reconstruction Gaussian smoothing, whereas only one reconstruction configuration was used for the Philips scans. …”
Get full text

Reliability and validity of the Veterans Administration Mobility Screening and Solutions Tool by Christine Melillo, Deborah Rugs, Peter Toyinbo, Blake Barrett, Margeaux Chavez, Linda Cowan, Susan Wyatt, Margaret Arnold, Pauline Hilton, Marie Martin, Jill Earwood, Sheila Cox Sullivan

“…The initial VA MSST draft iteration was reviewed by 163 VA staff (mostly physical therapists and occupational therapists) amongst simulation scenarios and provided content validity, and additional insight and suggestions. …”
Get full text

Towards reconstructing the Arctic atmospheric methane history over the 20th century: measurement and modelling results for the North Greenland Ice Core Project firn by T. Umezawa, S. Sugawara, K. Kawamura, K. Kawamura, K. Kawamura, I. Oyabu, S. J. Andrews, S. J. Andrews, T. Saito, S. Aoki, T. Nakazawa

“…We examine a variety of possible firn diffusivity profiles, using a suite of measured trace gases, and reconstruct the CH<span class="inline-formula">₄</span> mole fraction by an iterative dating method. Although the reconstructions of the Arctic CH<span class="inline-formula">₄</span> mole fraction before the mid-1970s still has large uncertainties (<span class="inline-formula">&gt;</span> 30 ppb – parts per billion), we find a relatively narrow range of atmospheric CH<span class="inline-formula">₄</span> history that is consistent with both depth profiles of NGRIP and NEEM. …”
Get full text

Electronic health record closed-loop referral (“eReferral”) to a state tobacco quitline: a retrospective case study of primary care implementation challenges and adaptations by Mark E. Zehner, Julie A. Kirsch, Robert T. Adsit, Allison Gorrilla, Kristine Hayden, Amy Skora, Marika Rosenblum, Timothy B. Baker, Michael C. Fiore, Danielle E. McCarthy

“…Both health systems engaged in iterative refinement of the EHR alert prompting eReferral, the eReferral order, trainings, and workflows. …”
Get full text

Residual temperature bias effects in stratospheric species distributions from LIMS by E. Remsberg, V. L. Harvey, A. Krueger, M. Natarajan

“…An error in <span class="inline-formula"><i>T</i>(<i>p</i></span>) affects species retrievals through (1) the Planck blackbody function in forward calculations of limb radiance that are part of the iterative retrieval algorithm of LIMS, and (2) the registration of the measured LIMS species radiance profiles in pressure altitude, mainly for the lower stratosphere. …”
Get full text

Making the Correct Diagnosis in Thrombotic Microangiopathy: A Narrative Review by Philip A. McFarlane, Martin Bitzan, Catherine Broome, Dana Baran, Jocelyn Garland, Louis-Philippe Girard, Kuljit Grewal, Anne-Laure Lapeyraque, Christopher Jordan Patriquin, Katerina Pavenski, Christoph Licht

“…Authors, through an iterative review process identified and synthesized information from relevant published studies. …”
Get full text

Target Product Profile for a Machine Learning–Automated Retinal Imaging Analysis Software for Use in English Diabetic Eye Screening: Protocol for a Mixed Methods Study by Trystan Macdonald, Jacqueline Dinnes, Gregory Maniatopoulos, Sian Taylor-Phillips, Bethany Shinkins, Jeffry Hogg, John Kevin Dunbar, Ameenat Lola Solebo, Hannah Sutton, John Attwood, Michael Pogose, Rosalind Given-Wilson, Felix Greaves, Carl Macrae, Russell Pearson, Daniel Bamford, Adnan Tufail, Xiaoxuan Liu, Alastair K Denniston

“…The document will be iterated between rounds based on participants’ feedback. …”
Get full text

Design of FPGA-Based SHE and SPWM Digital Switching Controllers for 21-Level Cascaded H-Bridge Multilevel Inverter Model by Emilia Noorsal, Asyraf Rongi, Intan Rahayu Ibrahim, Rosheila Darus, Daniel Kho, Samsul Setumin

“…The designed SHE switching controller mainly consists of a four-bit finite state machine (FSM) and a 13-bit counter, while the SPWM switching controller employs a simple iterative CORDIC algorithm with a small amount of data storage requirement, a six-bit up-down counter, and a few adders. …”
Get full text

An Audio Personal Health Library of Clinic Visit Recordings for Patients and Their Caregivers (HealthPAL): User-Centered Design Approach by Paul J Barr, William Haslett, Michelle D Dannenberg, Lisa Oh, Glyn Elwyn, Saeed Hassanpour, Kyra L Bonasia, James C Finora, Jesse A Schoonmaker, W Moraa Onsando, James Ryan, Martha L Bruce, Amar K Das, Roger Arend, Sheryl Piper, Craig H Ganoe

“…MethodsOur user-centered design and usability evaluation approach incorporated iterative rounds of video-recorded sessions from 2016 to 2019. …”
Get full text

Deep Learning Empowered Semi-Blind Joint Detection in Cooperative NOMA by Ahmet Emir, Ferdi Kara, Hakan Kaya, Halim Yanikomeroglu

“…We use a DL-based detection (DLDet) in both users instead of conventional detectors. Therefore, an iterative detector (i.e., successive interference canceler (SIC)) at the near user (UE1) and a combining plus optimum detector (i.e., maximum ratio combining (MRC) and maximum-likelihood (ML) detector) at the far user (UE2) are not required anymore. …”
Get full text

Asphericity of tumor FDG uptake in non-small cell lung cancer: reproducibility and implications for harmonization in multicenter studies by Julian M. M. Rogasch, Christian Furth, Stephanie Bluemel, Piotr Radojewski, Holger Amthauer, Frank Hofheinz

“…Reconstruction used OSEM with TOF4/16 (iterations 4; subsets 16; in-plane filter 2.0, 6.4 or 9.5 mm), TOF4/8 (4 it; 8 ss; filter 2.0/6.0/9.5 mm), PSF + TOF2/17 (2 it; 17 ss; filter 2.0/7.0/10.0 mm) or Bayesian-penalized likelihood (Q.Clear; beta, 600/1750/4000). …”
Get full text

A Web-Based Cancer Self-Management Program (I-Can Manage) Targeting Treatment Toxicities and Health Behaviors: Human-Centered Co-design Approach and Cognitive Think-Aloud Usability... by Doris Howell, Denise Bryant Lukosius, Jonathan Avery, Athina Santaguida, Melanie Powis, Tina Papadakos, Vincenzo Addario, Mike Lovas, Vishal Kukreti, Kristen Haase, Samantha J Mayo, Janet Papadakos, Saeed Moradian, Monika K Krzyzanowska

“…ObjectiveWe undertook a user-centered co-design process in partnership with patients and other knowledge end users to develop and iteratively test an evidence-based and theoretically informed web-based cancer self-management program (I-Can Manage). …”
Get full text

Holomorphic Extensions Associated with Fourier–Legendre Series and the Inverse Scattering Problem by Enrico De Micheli

“…The function <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><mi>f</mi><mo>(</mo><mi>θ</mi><mo>)</mo></mrow></semantics></math></inline-formula> is shown to have a holomorphic extension to a cut-domain, and from the discontinuity across the cuts we can iteratively reconstruct the spectral density <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><mi>σ</mi><mo>(</mo><mi>μ</mi><mo>)</mo></mrow></semantics></math></inline-formula> associated with the class of Yukawian potentials. …”
Get full text

Determination of the Initial Value Ranges of Nonlinear Solutions for a Log Ratio Bathymetric Inversion Model and Bathymetry Retrieval by Jiawei Qi, Dianjun Zhang, Zhaoyu Ren, Aijun Cui, Fei Yin, Jian Qin, Jie Zhan, Jinshan Zhu

“…So <inline-formula><tex-math notation="LaTeX">${\boldsymbol{n}}(0)$</tex-math></inline-formula> needs more iterations to achieve the optimal. Therefore, the initial value <inline-formula><tex-math notation="LaTeX">${\boldsymbol{n}}(0)$</tex-math></inline-formula> determines whether the optimization method can obtain credible LRM model parameters and the algorithm convergence speed. …”
Get full text

On the Nature and Origin of Atmospheric Annual and Semi-Annual Oscillations by Vincent Courtillot, Jean-Louis Le Mouël, Fernando Lopes, Dominique Gibert

“…This paper proposes a joint analysis of variations of global sea-level pressure (SLP) and of Earth’s rotation (RP), expressed as the coordinates of the rotation pole (<inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><msub><mi>m</mi><mn>1</mn></msub></semantics></math></inline-formula>, <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><msub><mi>m</mi><mn>2</mn></msub></semantics></math></inline-formula>) and length of day (lod). We retain iterative singular spectrum analysis (iSSA) as the main tool to extract the trend, periods, and quasi periods in the data time series. …”
Get full text

A novel nomogram to stratify quality of life among advanced cancer patients with spinal metastatic disease after examining demographics, dietary habits, therapeutic interventions,... by Yue Li, Ze Long, Xiuju Wang, Mingxing Lei, Chunzi Liu, Xiaolin Shi, Yaosheng Liu

“…Internal validation was also completed using the bootstrap method after applying 500 iterations of procedures. A web calculator was also developed to promote clinical practice. …”
Get full text

Parallel algorithms for scheduling data-graph computations by Hasenplaugh, William Cleaburn

Get full text

Unified framework to design efficient membrane distillation for brine concentration by Swaminathan, Jaichander

Get full text

The impact of distributed energy resources (DERs) in integrated gas-electricity energy systems by Yee, Alexander Wing Lake

Get full text