Is it possible to delete records in SF using External Id instead of SF Id?

Is it possible to delete records in SF using External Id instead of SF Id?