The past tense of let stay is also let stay.
The third-person singular simple present indicative form of let stay is lets stay.
The present participle of let stay is letting stay.
The past participle of let stay is let stay.