Use books and magazines at your local library for inspiration.
Collect cereal boxes to use for templates.
Save your gold coins for the two best art supply shops...the discount store and your local Op Shop!
Keep the ribbons you cut off new clothing.
Collect all your buttons in a jar.
Keep the lids from those little fish filled with soy sauce to use as beads.
Buy your origami paper on eBay. Search for 'crane paper' and it will only cost you $1 for ten small sheets (including postage)!