What is freedom? I'm not going to go too deep down the philosophical rabbit hole on that one, but one possible definition is happiness. You can be free in any situation if you are happy in it. There is an inversion here too: You are happy when you feel free. I'm not sure which precedes which, or if there is even a clear distinction.
The sense of freedom comes from knowing you are in the right place. Knowing that you are in a position where you can be and do all that you are, where what you know you need to do is given due space. It's not that you are unchallenged or free from setbacks, but you are in a position where the challenges and setbacks available to you are the right ones — the ones that push you further on to where you know you want to be.
There are times when you are not free nor happy. And certainly you must embrace and accept these times. Listen to what these times tell your heart and act boldly in response, doing what you know you ought.
When you do, you are free.