Pre-Conditioners for A to solve A\b.

Need pre-conditioner's for matrix A to solve x=A\b. Suggest some(with formulas). I am using right pre-conditioner diag(1./sqrt(sum(abs(A).^2))).

But its not working and I am getting bottom rows as zeros.

Please give me any pre-conditioner you know. I will try for my problem.