License Name In Flat Agreement And Issue With Deposit Return

We were 5 working employees stayed in a flat in Mumbai but only with one person agreement was made with the owner of the flat. As the time passed on, our friend who names is there in the agreement has left the flat and there is a point in the agreement that the agreement will not be transferred to another person so we asked him about this at the time but the owner was okay to continue with others flatmate even the names are not there in agreement. Now we all vacated the flat and while returning the deposit he has mentioned many deductions that will not come under any point which are in agreement. So when we asked the owner that as per agreement he cannot do those deductions as they will not come under any point. Now he is bringing up the point that an agreement was made with one person and that person has left the flat so as per the agreement you people are also violating the agreement so we cannot return the deposit. Please advise what can we do and any solution.