This where you're doing it wrong.
There's absolutely no reason to fistfight him. People will punch each other all the time in the beginning, but it is mostly just to push each other off the chests. If some guy starts punching you, just ignore him (try to take as few punches as possible, of course). Run off to your route. You'll regenerate your health quickly anyways.
On-topic. The ideal game:
Game starts
I run to the middle.
Get 1-2 sometimes 3 chests worth of stuff.
If i got armour or weapons, equip it.
Run off to my route, get more materials, weapons or armour.
Run back to the corn at mid-day, look for players.
Most of the time run in and fight.
Go back hunting for the rest of the day.
Come back before the chests refill.
Get loot.
Win.