Subaru outback for 4WDing. Talk me out of it

Or into it?

I have driven my '03 OB as my first and only car for years and it's served me brilliantly. I like long range road trips, fishing, camping and visiting national parks.

But there have been some situations where I haven't been able to get where I want to go, especially when on fire access tracks, beach driving, muddy tracks around the farm etc. I also like the idea of getting to more remote campsites away from crowds. I want something that can fit all my gear when I go fishing/camping without the arse sagging. And it should be comfortable towing a camper trailer or tinny. But- it'd also be my daily driver.

So I'm sure my current car won't last forever and looking at what the next one will be.

Right now i am still considering an outback with a few aftermarket modifications like -suspension lift -smaller wheels and higher profile all terrain tyres -skid plates -recovery points

Quick budgeting suggests I could snag a 2016 OB and even with the cost of those upgrades it'd be cheaper than something like a Prado of the same era.

For what I'm looking for, is there any reason to consider more 'real' 4x4s? This car would be my daily commuter as well as for adventures. I guess I'm giving up 4wd for AWD, no low range... How much difference will that make?

All advice serious or otherwise is appreciated

Edit: Bought a Pajero Sport and retired the Suby. Thanks everyone