This paper aims at explaining two stylized facts of the Lost Decade in Japan: rising wage inequalities and increasing firm-level productivity differentials. We build a model where firms can choose between efficiency wages with endogenous effort and competitive wages, and show that it can replicate those facts. Using Japanese microeconomic data, we find support for the existence of efficiency wages in one group of firms and competitive wages in the other group. Based on those results, a simulation shows that the share of firms using efficiency wages has declined, within sectors, during the Lost Decade, as predicted by the model.