I doubt that missing the distance collar (part 6) would cause your problem, that collar goes inside the center of the wheel between the bearings. If you don't have the bearings out you will never see it, although you wouldn't be the first person to forget to make sure it gets in there during re-assembly. I believe part 6 is there to reduce or redistribute side loads through the bearings. You would probably have drastically shortened bearing life without it, but it shouldn't cause a wheel misalignment. My guess is part 4 also.