Stochastic Control Through a Modern Lens: Applications in Supply Chain Analytics and Logistical Systems

The thesis investigates classical multi-period stochastic control problems through a modern lens, including stochastic inventory control, dynamic pricing and vehicle routing. A brief history of the academic works on stochastic control is presented in Chapter 1, where the relevance of papers on stoch...

Full description

Bibliographic Details
Main Author: Qin, Hanzhang
Other Authors: Simchi-Levi, David
Format: Thesis
Published: Massachusetts Institute of Technology 2022
Online Access:https://hdl.handle.net/1721.1/144691
_version_ 1826195246737784832
author Qin, Hanzhang
author2 Simchi-Levi, David
author_facet Simchi-Levi, David
Qin, Hanzhang
author_sort Qin, Hanzhang
collection MIT
description The thesis investigates classical multi-period stochastic control problems through a modern lens, including stochastic inventory control, dynamic pricing and vehicle routing. A brief history of the academic works on stochastic control is presented in Chapter 1, where the relevance of papers on stochastic processes, dynamic programming and reinforcement learning is also discussed. This thesis then focuses on revisiting inventory control, dynamic pricing and vehicle routing i) in a data-driven fashion; ii) with flexible architectures. Chapters 2-3 present several state-of-the-art results on data-driven inventory control. In Chapter 2, the following question is revisited: how much data is needed in order to obtain a (nearly) optimal policy for inventory control? To resolve this long-standing open question, a novel sample-based algorithm is proposed for the backlog setting and a matching (up to a logarithmic factor) lower-bound is also given. In Chapter 3, the same question for the joint pricing and inventory control problem is studied and the first sample-efficient solution is proposed. Chapter 4 is dedicated to the vehicle routing problem with stochastic demands (VRPSD). By combining ideas from vehicle routing and manufacturing process flexibility, a new approach to VRPSD is proposed, that uses overlapped routing with customer sharing in route determination, whose performance is close to the theoretical lower-bound, and significantly improves upon the routing strategy without overlapped routes. Chapter 5 concludes the thesis, and points out several future research directions.
first_indexed 2024-09-23T10:09:42Z
format Thesis
id mit-1721.1/144691
institution Massachusetts Institute of Technology
last_indexed 2024-09-23T10:09:42Z
publishDate 2022
publisher Massachusetts Institute of Technology
record_format dspace
spelling mit-1721.1/1446912022-08-30T03:50:41Z Stochastic Control Through a Modern Lens: Applications in Supply Chain Analytics and Logistical Systems Qin, Hanzhang Simchi-Levi, David Massachusetts Institute of Technology. Department of Civil and Environmental Engineering The thesis investigates classical multi-period stochastic control problems through a modern lens, including stochastic inventory control, dynamic pricing and vehicle routing. A brief history of the academic works on stochastic control is presented in Chapter 1, where the relevance of papers on stochastic processes, dynamic programming and reinforcement learning is also discussed. This thesis then focuses on revisiting inventory control, dynamic pricing and vehicle routing i) in a data-driven fashion; ii) with flexible architectures. Chapters 2-3 present several state-of-the-art results on data-driven inventory control. In Chapter 2, the following question is revisited: how much data is needed in order to obtain a (nearly) optimal policy for inventory control? To resolve this long-standing open question, a novel sample-based algorithm is proposed for the backlog setting and a matching (up to a logarithmic factor) lower-bound is also given. In Chapter 3, the same question for the joint pricing and inventory control problem is studied and the first sample-efficient solution is proposed. Chapter 4 is dedicated to the vehicle routing problem with stochastic demands (VRPSD). By combining ideas from vehicle routing and manufacturing process flexibility, a new approach to VRPSD is proposed, that uses overlapped routing with customer sharing in route determination, whose performance is close to the theoretical lower-bound, and significantly improves upon the routing strategy without overlapped routes. Chapter 5 concludes the thesis, and points out several future research directions. Ph.D. 2022-08-29T16:05:08Z 2022-08-29T16:05:08Z 2022-05 2022-06-15T20:49:35.537Z Thesis https://hdl.handle.net/1721.1/144691 0000-0002-2787-0685 In Copyright - Educational Use Permitted Copyright MIT http://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology
spellingShingle Qin, Hanzhang
Stochastic Control Through a Modern Lens: Applications in Supply Chain Analytics and Logistical Systems
title Stochastic Control Through a Modern Lens: Applications in Supply Chain Analytics and Logistical Systems
title_full Stochastic Control Through a Modern Lens: Applications in Supply Chain Analytics and Logistical Systems
title_fullStr Stochastic Control Through a Modern Lens: Applications in Supply Chain Analytics and Logistical Systems
title_full_unstemmed Stochastic Control Through a Modern Lens: Applications in Supply Chain Analytics and Logistical Systems
title_short Stochastic Control Through a Modern Lens: Applications in Supply Chain Analytics and Logistical Systems
title_sort stochastic control through a modern lens applications in supply chain analytics and logistical systems
url https://hdl.handle.net/1721.1/144691
work_keys_str_mv AT qinhanzhang stochasticcontrolthroughamodernlensapplicationsinsupplychainanalyticsandlogisticalsystems