Poravanthattil, Joshua
(2024)
Fault Mitigation for Spiking-Neural-Network Classification of Neuromorphic Event Streams with Radiation-Induced Noise.
Master's Thesis, University of Pittsburgh.
(Unpublished)
Abstract
The pursuit of autonomy for on-orbit processing drives the evolution of deep-learning (DL) systems for space applications. Hindered by limited compute capabilities on constrained embedded platforms, alternative technologies are being explored. Amidst the evolution of these DL systems, spiking neural networks (SNNs) coupled with neuromorphic sensing inputs offer an advantage compared to traditional DL frameworks, as SNNs offer lower latency, memory, computation requirements, and subsequent lower power usage. These benefits of neuromorphic systems make them highly amenable to space applications. Given the limited space-flight heritage of neuromorphic systems, the characterization of radiation effects on such algorithms and sensors is valuable for reliable implementations in space. Specifically, characterization of the adverse effects of radiation on neuromorphic systems can lead to development of effective fault-mitigation strategies. This research therefore aims to characterize the effects of simulated, radiation-induced noise on the classification capability of SNNs and explore contemporary fault-mitigation tactics. A fault-injection tool modeled from the results of a neutron-radiation test is leveraged to simulate noise. Using this tool, noise is injected into event-based sensor data and subsequently passed to an SNN for classification. This simulated neuromorphic system provides insight into the radiation-resiliency of SNNs as network hyperparameters such as width and depth are varied, as well as identifies the limitations of current denoising methodology. A novel event-rate denoising method is also introduced to increase the performance of SNN classification under higher magnitudes of the noise, outperforming the standard spatiotemporal filters currently used with event data suitable for radiation environments. The proposed filtering methodology outperforms standard spatio-temporal filtering methodology by $1.7\times$ at high simulated noise rates (100 events per second) on the complex DVS Gesture dataset, with an improved performance for a wider range of noise rates. The intrinsic reliability of SNNs, coupled with the enhanced event-rate filtering methodology offers a formidable DL alternative.
Share
| Citation/Export: |
|
| Social Networking: |
|
Details
| Item Type: |
University of Pittsburgh ETD
|
| Status: |
Unpublished |
| Creators/Authors: |
|
| ETD Committee: |
|
| Date: |
6 September 2024 |
| Date Type: |
Publication |
| Defense Date: |
29 July 2024 |
| Approval Date: |
6 September 2024 |
| Submission Date: |
12 July 2024 |
| Access Restriction: |
No restriction; Release the ETD for access worldwide immediately. |
| Number of Pages: |
44 |
| Institution: |
University of Pittsburgh |
| Schools and Programs: |
Swanson School of Engineering > Electrical and Computer Engineering |
| Degree: |
MS - Master of Science |
| Thesis Type: |
Master's Thesis |
| Refereed: |
Yes |
| Uncontrolled Keywords: |
Spiking Neural Networks, Reliability, Machine Learning, Bio-Inspired, Neuromorphic, Evaluation, Design, Computer Vision, Physical Sciences and Engineering |
| Date Deposited: |
06 Sep 2024 20:03 |
| Last Modified: |
06 Sep 2024 20:03 |
| URI: |
http://d-scholarship.pitt.edu/id/eprint/46676 |
Metrics
Monthly Views for the past 3 years
Plum Analytics
Actions (login required)
 |
View Item |
![[feed]](/images/feed-icon-32x32.png){kind=icon}