It seems like I remember reading that Carnegie bought Skibo because he was denied entry there many years prior. Or something like that. Anyway, yes, this is the greatest rags to riches story ever.
How about maybe the more relevant now riches to rags story of Nikola Tesla. Invented the age of electric power but had his inventions stolen and driven into bankruptcy by Thomas Edison. His later fame was even stolen because the government classified his papers.