Community Profile

photo

Emmanouil Tzorakoleftherakis


Last seen: 2 days ago

MathWorks

258 total contributions since 2018

Emmanouil Tzorakoleftherakis's Badges

  • Personal Best Downloads Level 1
  • Pro
  • Knowledgeable Level 4
  • GitHub Submissions Level 1
  • First Submission
  • 6 Month Streak
  • Revival Level 2
  • First Answer

View details...

Contributions in
View by

Answered
RL in dynamic environment
The following example seems relevant, please take a look: https://www.mathworks.com/help/robotics/ug/avoid-obstacles-using-rein...

13 days ago | 0

Answered
MPC Controller giving nice performance during designing but fails on testing
Hello, It sounds to me that the issue is with the linearized model. When you are exporting the controller from MPC Designer, yo...

15 days ago | 0

Answered
What is in a reinforcement learning saved agent .mat file
Why don't you load the file and check? When you saved the agen tin the .mat file, did you save anything else with it? Are you m...

25 days ago | 0

Answered
reinforcement learning PMSM-code
You can find the example here.

25 days ago | 0

| accepted

Answered
How to deal with a large number of state and action spaces?
Even if the NX3 inputs are scalars, I would reorganize them into an "image" and use imageInput layer for the first layer as oppo...

25 days ago | 0

Answered
Q learning algorithm in image processing using matlab.
Hello, Finding an example that exactly matches what you need to do may be challenging. If you are looking for the "deep learnin...

1 month ago | 0

| accepted

Answered
Need help with Model based RL
Hello, If you want to use the existing C code to train with Reinforcement Learning Toolbox, I would use the C caller block to b...

1 month ago | 1

| accepted

Answered
How to set the reinforcement learning block in Simulink to output 9 actions
Hello, the example you are referring to does not output 3 values for the pid gains. The PID gains are "integrated" into the neu...

1 month ago | 0

Answered
Where to update actions in environment?
Reinforcement Learning Toolbox agents expect a static action space, so fixed number of options at each time step. To create a dy...

1 month ago | 0

Answered
How to check the weight and bias which taked by getLearnableParameters?
Can you provide some more details? What does 'wrong answer' mean? How do you know the weights you are seeing are not correct? Ar...

1 month ago | 0

Answered
Gradient in RL DDPG Agent
If you put a break point right before 'gradient' is called in this example, you can step in and see the function implementation....

1 month ago | 0

| accepted

Answered
Soft Actor Critic deploy mean path only
Hello, Please take a look at this option here which was added in R2021a to allow exactly the behavior you mentioned. Hope this...

1 month ago | 0

| accepted

Answered
How to pretrain a stochastic actor network for PPO training?
Hello, Since you already have a dataset, you will have to use Deep Learning Toolbox to get your initial policy. Take a look at ...

1 month ago | 1

Answered
Failure in training of Reinforcement Learning Reinforcement Learning Onramp
Hello, We are aware and working to fix this issue. In the meantime, can you take a look at the following answere? https://www....

2 months ago | 0

Answered
DQN Agent with 512 discrete actions not learning
I would initially revisit the critic architecture for 2 reasons: 1) Network seems a little simple for a 3->512 mapping 2) This...

2 months ago | 0

Answered
How does the Q-Learning update the qTable by using the reinforcement learning toolbox?
Can you try critic.Options.L2RegularizationFactor=0; This parameter is nonzero by default and likely the reason for the discre...

2 months ago | 0

Answered
File size of saved reinforcement learning agents
Hello, Is this parameter set to true? If yes, then it makes sense that mat files are growing in size as the buffer is being pop...

2 months ago | 0

| accepted

Answered
Saving Trained RL Agent after Training
Setting the IsDone flag to 1 does not erase the trained agent - it actually makes sense that the sim was not showing anything be...

2 months ago | 0

| accepted

Answered
How to Train Multiple Reinforcement Learning Agents In Basic Grid World? (Multiple Agents)
Training multiple agents simultaneously is currently only supported in Simulink. The predefined Grid World environments in Reinf...

2 months ago | 0

| accepted

Answered
How to create a neural network for Multiple Agent with discrete and continuous action?
If you want to specify the neural network structures yourself, there is nothing specific you need to do - simply create two acto...

2 months ago | 0

| accepted

Answered
Is it possible apply Reinfocrement Learning to classify data?
If you already have a labeled dataset, supervised learning is the way to go. Reinforcement learning is more for cases where data...

2 months ago | 0

| accepted

Answered
Combining two deep neural networks to train simultaneously
Hello, You can do this in Simulink - see the following examples for reference. https://www.mathworks.com/help/reinforcement-l...

2 months ago | 1

| accepted

Answered
DQN learns at first but then worsens.
To confirm that this is an exploration issue, can you try setting the EpsilonMin param to a high value? e.g. 0.99. If after doin...

2 months ago | 0

Answered
How to resume train a trained agent?about Q learning agents.
Hello, To see how to iew the table values, take a look at the answer here. Also, you don't have to do anything specific to con...

2 months ago | 0

| accepted

Answered
Reinforcement learning action getting saturated at one range of values
Your scaling layer is not set up correctly. You want to scale to (upper limit-lower limit) and then shift accordingly. scaling...

2 months ago | 0

| accepted

Answered
How can I provide constraints to the actions provided by the Reinforcement Learning Agent?
Hard constraints are not typically supported during training in RL. You can specify limits/constraints as you mention above, but...

2 months ago | 0

| accepted

Answered
Exporting data only works as pdf. Axis labels are getting small and unreadable
You cannot save as .fig from the episode manager plot. If you have the training data though (it's good practice to save this dat...

2 months ago | 1

| accepted

Answered
Reinforcement Learning multiple agent validation: Can I have a Simulink model host TWO agents and test them
That should be possible. Did you follow the multi-agent examples? Since the agents are trained already you may want to check the...

3 months ago | 0

| accepted

Answered
Do the actorNet and criticNet share the parameter if the layers have the same name?
No, each network has its own parameters. Shared layers are not supported out of the box, you would have to implement custom trai...

3 months ago | 0

| accepted

Answered
Any RL Toolbox A3C example?
Hello, To get an idea of what an actor/critic architecture may look like, you can use the 'default agent' feature that creates ...

3 months ago | 0

| accepted

Load more