FOURTH AMENDMENT TO EMPLOYMENT AGREEMENT

Exhibit 10.22

FOURTH AMENDMENT TO

EMPLOYMENT AGREEMENT

WHEREAS, Casual Male Retail Group, Inc., (formerly Designs, Inc., “CMRG”) and Dennis R. Hernreich (“Executive”) entered into a certain Employment Agreement dated as of August 14, 2000, as amended by Letter Agreement dated April 25, 2001, Second Amendment to Employment Agreement dated January 30, 2003 and Third Amendment to Employment Agreement dated July 9, 2003 (hereinafter referred to as the “Agreement”); and

WHEREAS, Company and Executive wish to amend, modify and/or restate certain terms, provisions, conditions, and covenants of the Agreement.

NOW, THEREFORE, in consideration of the foregoing, and of the promises, covenants, conditions and agreements contained herein, and for One Dollar ($1.00) and for other good and valuable consideration, the receipt and sufficiency of which is hereby expressly acknowledged, the Company and Executive hereby agree to amend the Agreement as follows:

“3. COMPENSATION

(a) As compensation for the employment services to be rendered by the Executive hereunder, the Company agrees to pay to Executive, and Executive agrees to accept, payable in equal installments in accordance with Company practice, an annual base salary of $440,000, effective as of May 1, 2004.”

IN WITNESS WHEREOF, the parties hereto have executed this Fourth Amendment to Employment Agreement as a sealed instrument, in any number of counterpart copies, each of which shall be deemed an original for all purposes, as of May 1, 2004.

CASUAL MALE RETAIL GROUP, INC. (Company)