The life-support weight and g-force worrying can be dropped, but I think parameters like wing-loading, range, load capacity, the radar and its power generation will set the size of a fighter plane to be pretty much that of a fighter, even if you drop the pilot.