Permitted work

It will not go against you, but it will be taken into account. For instance, if you claim to have a bad back but you work in a job that requires lifting and carrying, that will raise questions. If you claim to be agoraphobic and never leave the house, but then take a job in retail again that may raise a doubt.

If you're honest in your ESA50, that you are making steps towards getting better but you are still limited in what you can do, then it will not cause an issue.