To remove a flag from a day's Job Log entry, go to that date and click the desired flag, making it change from red (selected) to grey (unselected).
To completely remove a flag from your customized list, go to Settings > Account > Job Log. Click "delete" for the desired flag. The system with then give you the option to reassign the flags you are about to delete, if so desired.