The "crusties" are normal. What those are is your white blood cells trying to patch the hole that was just created in your body. That is your body's natural defense mechanism. To remove them, soak your ear in warm water for 2 minutes to ensure that the "crusties" are saturated. Then, just simply remove them with a q-tip. The crusties need to be soft to ensure that you do not cause any tissue damage to your ear.
It is not too late to start using soap -- in fact, you should stop what you are doing and start using soap now.
