How to decrease milk supply (PLEASE HELP)?

I have recently given birth to my son on Febuary 12, at this moment he is 5 days old and my milk supply is out of control!!! I have to pump milk because my are flat to my and he cant latch on. I have been pumping every 2-3 hours before feedings and i am pumping 4 ounces from each in one 10 minutes sitting!!! By the time its time too pump, my are fully engored, extremely sore and leaking thru pads like no tomarrow. Is there any way I can easily decrease my supply!?