Question

Should I use L1 or L2?

Answer 1

So in summary: Use L1 regularization for linear models and when feature selection is required. Use L2 regularization for neural networks and when all features are informative.