Clay can be found in the mine. Clay is a very rare resource. Keep going down into the depths of the mine and you will definitely be able to get it. Note that you can only collect clay with a pickaxe. Dynamite and TNT destroy clay, so make sure there's no clay in the blast radius before using the explosives. Good luck!