First of all you need to ensure you can survive, feed yourself and your family, and pay your bills.
These are necessities. Don't mix your wants with the needs. We work to minimally meet our needs. The wants should come from extra remaining after deduct the portion for savings.

If the needs are manageable financially, then you are free to choose whatever career you want. Most importantly, don't regret your decision. That is, should you switch, don't regret it even if it fail. Should you choose to stay on, don't regret later in life that you did not make the switch. In short, make the decision that you will not regret (while ensuring you can meet your needs).