How to Convert Entity Attribute Buses into Signal for RL Agent Observation Input?
6 views (last 30 days)
Show older comments
Aaron Bramhasta
on 17 Jul 2024
Commented: Aaron Bramhasta
on 29 Jul 2024
Dear Matlab Simulink Experts,
I am having troubles with my model, right now I have designed a model to emulate a single part that goes through operations and maintenance procedures. I am utilizing bus elements in an entity generator, the next step of my model is to connect the intended output of the model from entity server 'damage' to an observation input port of the RL agent block. The RL agent block will then produce an output through the action port, connected again to an option of entity servers. How do I convert and entity attribute into a signal that the RL agent can receive, and vice versa, how do I revert back the signal into an entity attribute, after the RL agent has made its decision? Or what are other options other than converting entities to signal?
The attempts I have made were using a signal conversion block, and a Matlab function block, but my efforts hasn't been rewarding so far.
Your help would be very much appreciated. Attached are my files:
- ModelV1.slx (the simulink model)
- BusProfile.mat (the bus elements containing the entity attribute)
- initialize.m (to initialize the bus editor)
- RLScriptV4.mlx (the Reinforcement Learning script)
And this is the error generated:
Thank you in advance.
0 Comments
Accepted Answer
Laurent Royer
on 18 Jul 2024
Hi Aaron,
To convert an entity attribute into a signal, you can use a Simulink function. For example, to get the D attribute as a signal:
Add a Simulink Function "getD" as below:
This Simulink Function simply contains:
And you call it from your server complete action, see the last command below:
7 Comments
Laurent Royer
on 24 Jul 2024
I think there's an algebraic loop that you should break. Try inserting a Memory block just before the Simulink function getAction.
More Answers (0)
See Also
Categories
Find more on Discrete-Event Simulation in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!