Service mesh – enhancing the resiliency, security, observability and availability of the live stream ASR cloud deployment
The aim of this project is to improve the resiliency, enhance the observability level, raise the security level and bring about better deployment workflows of an existing automated speech recognition (ASR) system on the cloud. The ASR is currently adopting a typical microservices architecture, which...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Final Year Project (FYP) |
| Language: | English |
| Published: |
Nanyang Technological University
2022
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/162905 |
| _version_ | 1811696299193401344 |
|---|---|
| author | Goh, Jun Le |
| author2 | Chng Eng Siong |
| author_facet | Chng Eng Siong Goh, Jun Le |
| author_sort | Goh, Jun Le |
| collection | NTU |
| description | The aim of this project is to improve the resiliency, enhance the observability level, raise the security level and bring about better deployment workflows of an existing automated speech recognition (ASR) system on the cloud. The ASR is currently adopting a typical microservices architecture, which can lead to increased complexities in monitoring and managing the services in terms of security, observability, resiliency and availability as the system scales and evolves to be part of a more complex system.
The implemented solutions involve the use of a service mesh and are mainly driven by the Istio service mesh. Firstly, traffic management strategies like circuit breaker and fault injection policies are used to help improve the ASR’s resiliency to failures. Next, mutual TLS encryption communication between services enforced by the Istio’s certificate authority helps to make data communication more secure within the Kubernetes cluster. In addition, deployment strategies like canary deployment will significantly boost the availability level by careful management of deploying new features. Lastly, metrics collected by the service mesh on the proxy, service and control plane level provide greater visibility into interactions between services.
In this report, these solutions will be further illustrated through figures and details on how they work and serve to bridge the existing gaps in the ASR. Experiments will be carried out to test the efficacy and tradeoffs of these solutions. |
| first_indexed | 2024-10-01T07:37:09Z |
| format | Final Year Project (FYP) |
| id | ntu-10356/162905 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T07:37:09Z |
| publishDate | 2022 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1629052022-11-14T01:45:08Z Service mesh – enhancing the resiliency, security, observability and availability of the live stream ASR cloud deployment Goh, Jun Le Chng Eng Siong School of Computer Science and Engineering ASESChng@ntu.edu.sg Engineering::Computer science and engineering::Software::Software engineering The aim of this project is to improve the resiliency, enhance the observability level, raise the security level and bring about better deployment workflows of an existing automated speech recognition (ASR) system on the cloud. The ASR is currently adopting a typical microservices architecture, which can lead to increased complexities in monitoring and managing the services in terms of security, observability, resiliency and availability as the system scales and evolves to be part of a more complex system. The implemented solutions involve the use of a service mesh and are mainly driven by the Istio service mesh. Firstly, traffic management strategies like circuit breaker and fault injection policies are used to help improve the ASR’s resiliency to failures. Next, mutual TLS encryption communication between services enforced by the Istio’s certificate authority helps to make data communication more secure within the Kubernetes cluster. In addition, deployment strategies like canary deployment will significantly boost the availability level by careful management of deploying new features. Lastly, metrics collected by the service mesh on the proxy, service and control plane level provide greater visibility into interactions between services. In this report, these solutions will be further illustrated through figures and details on how they work and serve to bridge the existing gaps in the ASR. Experiments will be carried out to test the efficacy and tradeoffs of these solutions. Bachelor of Engineering (Computer Science) 2022-11-14T01:45:07Z 2022-11-14T01:45:07Z 2022 Final Year Project (FYP) Goh, J. L. (2022). Service mesh – enhancing the resiliency, security, observability and availability of the live stream ASR cloud deployment. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/162905 https://hdl.handle.net/10356/162905 en application/pdf Nanyang Technological University |
| spellingShingle | Engineering::Computer science and engineering::Software::Software engineering Goh, Jun Le Service mesh – enhancing the resiliency, security, observability and availability of the live stream ASR cloud deployment |
| title | Service mesh – enhancing the resiliency, security, observability and availability of the live stream ASR cloud deployment |
| title_full | Service mesh – enhancing the resiliency, security, observability and availability of the live stream ASR cloud deployment |
| title_fullStr | Service mesh – enhancing the resiliency, security, observability and availability of the live stream ASR cloud deployment |
| title_full_unstemmed | Service mesh – enhancing the resiliency, security, observability and availability of the live stream ASR cloud deployment |
| title_short | Service mesh – enhancing the resiliency, security, observability and availability of the live stream ASR cloud deployment |
| title_sort | service mesh enhancing the resiliency security observability and availability of the live stream asr cloud deployment |
| topic | Engineering::Computer science and engineering::Software::Software engineering |
| url | https://hdl.handle.net/10356/162905 |
| work_keys_str_mv | AT gohjunle servicemeshenhancingtheresiliencysecurityobservabilityandavailabilityofthelivestreamasrclouddeployment |