Purple Cavy Palace

You're not a cavy lover until you admit you're a cavy slave.

Fleece

It soft for your piggies feet and warm in the winter. It is also pretty because you can pick patterns  and colors. You can also do themes with fleece.
You can put a couple layers of towels under the fleece. You may only have to wash it once a week or more. It all depends how much your piggies are messy.

Carefresh

It is soft and dust-free, but it can mold quickly when it becomes wet. Carefresh is made of wood pulp by-products from the pulp and paper industry used in the manufacture of paper and cardboard. They don't use dye nor chemicals, and it's virtually dust-free.

Wood Shavings

Don't even consider cedar. The fragrant oils (phenols) are toxic and can cause respiratory damage to your piggy.  Pine, especially, is often debated because it contains fragrant oils in its natural state, but oven/kiln-dried pine is available.

Straw and hay

Both are popular as burrowing material, but remember that they can mold rather quickly. A soft pile of hay makes a great burrowing spot for your cavy. But beware of sharp ends that can poke your cavy in the eye. If you want to use straw and hay, use it as a top layer with some newspaper or other bedding below it. Make sure that it's not moldy to begin with, and break up long, hard bits of straw that can be sharp.

Kitty litter and other bedding

Any type of traditional clay-based kitty litters are not suitable for small animals. Be aware of dust, strong fragrances, and hardness. Dust and fragrance are harmful for your guinea pig's respiratory system.