Yes, you can. Keep in mind these materials often turn brown in soap, so test carefully to make sure you get the desired outcome. Calendula petals or loofa pieces often do well for additions to soap.