Abstract
Time Delay Reservoir (TDR) can exhibit effects of high dimensionality and short-term memory based on delay differential equations (DDEs), as well as having hardwarefriendly characteristics. However, the predictive performance and memory capacity of the standard TDRs are still limited, and dependent on the hyperparameter of the oscillation function. In this paper, we first analyze these limitations and their corresponding reasons. We find that the reasons for such limitations are fused by two aspects, which are the trade-off between the strength of selffeedback and neighboring-feedback caused by neuron separation, as well as the unsuitable order setting of the nonlinear function in DDE. Therefore, we propose a new form of TDR with secondorder time delay to overcome such limitations, incurring a more flexible time-multiplexing. Moreover, a parameter-free nonlinear function is introduced to substitute the classic Mackey-Glass oscillator, which alleviates the problem of parameter dependency. Our experiments show that the proposed approach achieves better predictive performance and memory capacity compared with the standard TDR. Our proposed model also outperforms six other existing approaches on both time series prediction and recognition tasks.
Original language | English |
---|---|
Title of host publication | 2021 IEEE Symposium Series on Computational Intelligence (SSCI) |
Publisher | Institute of Electrical and Electronics Engineers (IEEE) |
Number of pages | 8 |
ISBN (Electronic) | 9781728190488 |
ISBN (Print) | 9781728190495 (PoD) |
DOIs | |
Publication status | Published - 24 Jan 2022 |
Event | IEEE Symposium Series on Computational Intelligence (IEEE SSCI 2021) - Orlando, United States Duration: 5 Dec 2021 → 7 Dec 2021 |
Publication series
Name | IEEE Symposium Series on Computational Intelligence |
---|---|
Publisher | IEEE |
ISSN (Electronic) | 2770-0097 |
Conference
Conference | IEEE Symposium Series on Computational Intelligence (IEEE SSCI 2021) |
---|---|
Abbreviated title | IEEE SSCI 2021 |
Country/Territory | United States |
City | Orlando |
Period | 5/12/21 → 7/12/21 |
Bibliographical note
Publisher Copyright:© 2021 IEEE.
Keywords
- Multiplexing
- Delay effects
- Time series analysis
- Neurons
- Predictive models
- Reservoirs
- Data models
ASJC Scopus subject areas
- Artificial Intelligence
- Decision Sciences (miscellaneous)
- Control and Optimization
- Safety, Risk, Reliability and Quality
- Computer Science Applications