In this paper, we study the fault-tolerant facility location problem with penalties (FTFLPWP) by presenting an LP-rounding 4-approximation algorithm, and then improving the ratio to 3.16 via the randomized rounding technique. Furthermore, we improve the ratio 3.16 to 2.408 by greedy augmentation technique.