Most companies that have supporting supply chains have some form of supplier rating system. Unfortunately, many of those systems do not do what they are intended to do, which is lead to supplier improvement. In a recent issue of Supply Chain Management Review, there is a good primer on supply chain scorecards. While the article is a bit lengthy, it provides a good overview.