Agree with Loren.
A 170 is a giant headsail with the Center of Effort (CE) quite far aft. And if it's old, the CE will be even farther back making weather helm unbearable. In all but the lightest conditions, a 170 is too much sail. This alone is probably your problem.
Doesn't make sense to reef with that big headsail, unless that's the only one you've got. Generally you don't reef until your smallest, good quality jib is still too big.
Also, raking the mast will increase weather helm, not decrease it. This is because tilting the mast back moves the CE aft, pulling the stern downwind and pushing the bow into the wind.
Also as Loren said, excess heal causes the boat to point up into the wind. So you react by cranking on the rudder in order to sail your course.
So, rather than adding rudder, try the following:
Main trim:
1. Harden your main halyard and Cunningham. This move the CE forward a little.
2. Harden your outhaul. This flattens the bottom 1/3 of the main and reduces drag (heeling).
3. Drop the traveler as far as you can. This decreases the sail’s angle of attack and is your first defense against being over powered.
4. Make sure you're main isn't over trimmed. The aft half of your top batten should be parallel with (or slightly open to) the boom, not hooked in. The hook will add tons of drag (heel) and only a little more lift.
Jib trim:
1. Harden the backstay. This takes the sag out of the forestay and moves the CE forward.
2. Slightly harden the jib halyard. But don't overdo it.
3. Move the fairleads back. This flattens the bottom of the sail and allows the top to twist off, reducing drag.
Ballast:
Get your palls out on the windward rail. It’s hard to imagine a flat boat with weather helm.</SPAN>
If those things don’t work, check your rig tune. The lowers may be too loose compared to the uppers. This would cause your mast to bow leeward and give the mainsail more shape, power, and drag. But this is probably not your problem.</SPAN>
I know all this stuff is really basic. But it's good to start and the beginning. </SPAN>
If all of the above are being done correctly, the problem will be with either the boat's design (not likely) or the sails being so worn out that they produce significantly more drag than lift.
Good luck,
</SPAN>