I believe you may be missing the spacing collar (if that is what it's called) ... If my memory serves, It is about 1/2 " long and fits over the axle on the brake side. Don't take my post as definite, I'll go check a diagram and get back to this.... you should be able to get one from the gen discussion, quick reference topic as well. Always best to not have "leftovers" after re-assembly

Edited: checked the shop manny and it probably is the collar... there is also a longer distance collar behind the wheel bearing. The Rubber bushing you mention is a dust seal.
Sec 13 page 6.
I'm not positive, but I think leaving the that collar out is going to let the wheel move from side to side on the axle. The front brake pads might be the only thing keeping the wheel centered at all... without the brake pads, the wheel could slide on the axle about the length of that collar. I'd fix this asap as the brakes could be headed for a bad failure at the pads. Possibly locking up.