Polka-Dots and Stripes?

I love this whole trend going on right now that is about mixing up patterns and textures, however I find myself wondering if it is easier said than done. I have studied the texts (Glamour, Elle, InStyle, etc...) like a good student, but I am still unsure as to how its done.  I have a skirt and top that I really like separately, and according to "fashion experts" they should work together fabulously..... but I am simply not convinced... what do you think?

(skirt is from Anne Taylor Loft $49, top is from Old Navy $15 (on sale))