Grouped together dead carcasses of insects, found one alive but it looked like a small little caterpillar

I will assume you are asking for help identifying these "shells" or help getting rid of living ones.

For identification, let me ask if there is any way for you to post a picture or a link to one. Your description could apply to many different species, from carpet beetles to millipedes to bedbugs. The "little caterpillar" leads me to lean towards millipedes, but a specimen I.D. is still necessary.

Until you identify these insects/carcasses, advice on getting rid of them must be limited to general sanitation measures such as vacuuming and regulating humidity.