^I personally can. Might not be the reason as to why he dislikes it but have you never been almost driven mad when trying to get rid of single grains of sand? You get rid of one, you spot another one. Especially nasty when it gets between your teeth.
I don't have a problem with the texture itself and I do like sand somewhat... at the beach. Where it belongs. Where it doesn't belong but often find its way nonetheless to is the house, my clothes, etc. Anakin was absolutely right when he said: "It gets everywhere!"