Down jacket with toggle detail