Can I notify the on-call engineer first, and escalate it to the team members if the alert is not acknowledge in 10 minutes?

Yes. You can create an on-call schedule and an escalation and specify both as the recipients of the alert.