Design a custom loss function for training a neural network on a highly imbalanced dataset for anomaly detection in financial transactions. The function should heavily penalize false negatives while maintaining gradient stability. Provide the Python code using TensorFlow or PyTorch for implementing this loss function and explain the mathematical derivatives involved in backpropagation.