Oil pastels and watercolors?

im makeing a project for a cl of mine and i was thinking about putting down a watercolor background then putting oil pastel on it then scartching it away to bring the watercolor out....it that work or will the oil screw it all up