Thank you guys for the reply. Sorry for the delay.
Just an update:-
It was a hassle at the airport. We had to talk to the FRRO officer at the airport and he did allow us to go, but we faced problem in the UK immigration as well.
But thank you for your replies guys!