Getting every single perk would make the game extremely easy man. You are also level 40, which is not even halfway to the level cap so you have plenty of time to fix whatever is causing you to get killed by fucking Forsworn. High level Forsworn tend to be pretty tough keep in mind, their ranks have a pretty steep curve.
I don't know what your skill focuses are but if you have invested in smithing and enchantment (and alchemy if you really want to push your power) you can give yourself a hell of a boost. It depends on if you spread yourself thin or not. If you've maxed one handed and used the relevant perks the next thing you need is a kickass weapon, because for me most enemies were easy to wipe out by 40-45. By level 60 if you have used perks and skills wisely you will kick anythings ass, dragons will barely get a chance to land.
I don't know what your skill focuses are but if you have invested in smithing and enchantment (and alchemy if you really want to push your power) you can give yourself a hell of a boost. It depends on if you spread yourself thin or not. If you've maxed one handed and used the relevant perks the next thing you need is a kickass weapon, because for me most enemies were easy to wipe out by 40-45. By level 60 if you have used perks and skills wisely you will kick anythings ass, dragons will barely get a chance to land.