Margaret Fuller, American feminist and transcendentalist writer of 19th century uses the phrase "ornaments of society" in her 1843 book, Summer on the Lakes. She describes Eastern women's lifestyle, noting lack of resources available for them. The reason is that they are women living in patriarchal societies.
