Can the participants that I sent my meeting request change the time?

Yes, they can. When you make this change, the field shown in yellow on your calendar turns blue, indicating that the participant is requesting an appointment from you.