If you are in a state where the currently level cannot be completed, Red Ball will frown. This usually happens after you have lost an item that was necessary to complete the level.