Put differently:
Is there a good reason to choose a loosely-typed collection over a type-safe one (HashTable vs. Dictionary)? Are they still there only for compatibility?
As far as I understand, generic collections not only are type-safe, but their performance is better.
Here’s a comprehensive article on the topic: An Extensive Examination of Data Structures Using C# 2.0.
The non-generic collections are so obsolete that they’ve been removed from the CoreCLR used in Silverlight and Live Mesh.